-- Logs begin at Fri 2022-09-23 13:06:21 UTC, end at Fri 2022-09-23 14:26:55 UTC. -- Sep 23 13:53:19.753656 dv-cinder-857434-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 23 13:53:19.763973 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 23 13:53:19.765947 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 13:53:19 2022] *** Sep 23 13:53:19.765947 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 13:53:19.765947 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 13:53:19.765947 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: nodename: dv-cinder-857434-4-iscsi Sep 23 13:53:19.765947 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: machine: x86_64 Sep 23 13:53:19.765947 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: clock source: unix Sep 23 13:53:19.765947 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: pcre jit disabled Sep 23 13:53:19.765947 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: detected number of CPU cores: 4 Sep 23 13:53:19.765947 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: current working directory: / Sep 23 13:53:19.765947 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: detected binary path: /usr/bin/uwsgi-core Sep 23 13:53:19.765947 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: your processes number limit is 47680 Sep 23 13:53:19.766627 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: your memory page size is 4096 bytes Sep 23 13:53:19.766627 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: detected max file descriptor number: 2048 Sep 23 13:53:19.766627 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: lock engine: pthread robust mutexes Sep 23 13:53:19.766627 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: thunder lock: enabled Sep 23 13:53:19.766627 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 23 13:53:19.766627 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 13:53:19.804152 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: Python main interpreter initialized at 0x55aef7f629c0 Sep 23 13:53:19.804152 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: python threads support enabled Sep 23 13:53:19.804152 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: your server socket listen backlog is limited to 100 connections Sep 23 13:53:19.804152 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: your mercy for graceful operations on workers is 90 seconds Sep 23 13:53:19.804504 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 13:53:19.804583 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: *** Operational MODE: preforking *** Sep 23 13:53:19.804811 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: *** uWSGI is running in multiple interpreter mode *** Sep 23 13:53:19.804811 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: spawned uWSGI master process (pid: 105866) Sep 23 13:53:19.805011 dv-cinder-857434-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 23 13:53:19.805556 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: spawned uWSGI worker 1 (pid: 105867, cores: 1) Sep 23 13:53:19.805877 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: spawned uWSGI worker 2 (pid: 105868, cores: 1) Sep 23 13:53:19.806082 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 13:53:20.459519 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 13:53:20.483253 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 13:53:21.541026 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 13:53:21.541026 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: from cryptography.utils import int_from_bytes Sep 23 13:53:21.541608 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 13:53:21.541608 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: from cryptography.utils import int_from_bytes Sep 23 13:53:21.554052 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 13:53:21.554052 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: from cryptography.utils import int_from_bytes Sep 23 13:53:21.554525 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 13:53:21.554525 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: from cryptography.utils import int_from_bytes Sep 23 13:53:24.067820 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 13:53:24.068382 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 13:53:24.068586 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 13:53:24.068936 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 13:53:24.069186 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 13:53:24.069327 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 13:53:24.069678 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.069811 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 13:53:24.069888 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.070100 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 13:53:24.070222 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.070482 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 13:53:24.070600 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.070731 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 13:53:24.070819 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.071094 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.071190 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.071406 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.071512 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.071714 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.071799 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.072030 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.072207 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.072353 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.072660 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.072750 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.072978 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.073159 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.073291 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.073486 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857434-4-iscsi {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.073611 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.073807 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.073898 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.074111 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.074209 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.074444 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.074533 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857434-4-iscsi {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.074760 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.074845 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.075589 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.076650 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.077393 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.077503 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.077503 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.077715 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.077833 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.077833 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.078043 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.078164 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.078267 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.078404 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.078537 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.078665 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.078796 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.078886 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.079012 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.079103 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.079192 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.079317 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.079407 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.079486 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.079563 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.079699 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.079789 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.079876 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.079954 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.080030 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.080214 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.080312 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.080587 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.080693 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857434-4-iscsi {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.080906 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.080997 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857434-4-iscsi {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.081214 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.081305 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.081523 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.081610 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.081868 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.081959 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.082216 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.082405 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.082534 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.082616 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.082844 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.082932 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.083165 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.083254 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.083467 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.083563 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.083786 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.083871 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.084097 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.084184 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.084408 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.084498 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.084717 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.084838 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.085013 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.085100 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.085312 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.085397 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.085614 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.085707 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.085922 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.086009 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.086220 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.086305 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.086545 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.086646 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.086787 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.086873 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.087086 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.087178 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.087390 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.087490 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.087699 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.087784 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.088012 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.088096 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.088255 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.088350 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.088499 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.088597 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.088795 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.088934 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.089106 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.089193 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.089405 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.089500 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.089705 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.089799 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.090004 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.090091 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.090302 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.090419 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.090662 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.091735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.091821 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.091821 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.091961 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.092069 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.092170 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.092382 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.092477 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.092696 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.092829 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.093013 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.093196 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.093316 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.093415 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.093627 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.093715 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.093933 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.094027 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.094243 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.094358 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.094570 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.094657 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.094899 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.094993 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.095207 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.095294 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.095759 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.095857 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.096068 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.096157 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.096380 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.096480 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.096681 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.096767 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.096981 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.097077 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.097280 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.097374 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.097580 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.097664 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.097884 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.097983 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.098186 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.098278 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.098454 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.098602 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.098750 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.098904 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.099046 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.099139 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.099357 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.099456 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.099655 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.099749 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.099954 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.100040 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.100252 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.100355 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.100544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.100631 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.100845 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.100957 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.101140 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.101238 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.101438 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.101546 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.101735 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.101822 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.102033 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.102126 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.102347 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.102475 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.102646 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.102731 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.102944 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.103052 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.103240 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.103332 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.103535 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.103628 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.103833 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.103928 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.104132 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.104219 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.104426 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.104525 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.104723 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.104812 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.105018 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.105112 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.105316 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.105402 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.105613 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.105707 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.105907 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.105991 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.106204 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.106309 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.106844 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.106946 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.107028 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.107106 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.107183 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.107272 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.107422 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.107518 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.107721 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.107808 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.108019 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.108104 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.108326 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.108413 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.108618 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.108712 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.108914 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.109007 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.109219 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.109310 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.109517 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.109608 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.109813 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.109899 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.110106 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.110192 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.110423 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.110517 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.110718 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.110822 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.111015 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.111113 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.111304 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.111390 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.111598 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.111699 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.111888 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.111975 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.112184 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.112269 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.112480 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.112574 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.112777 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.112869 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.113079 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.113166 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.113373 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.113470 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.113676 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.113762 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.113979 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.114068 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.114294 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:53:24.114406 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.114649 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.114747 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.114953 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.115086 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.115275 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.115364 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.115595 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.115687 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.115902 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.115988 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.116208 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.116295 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.116512 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.116597 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.116826 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.116919 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.117127 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.117214 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.117429 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.117525 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.117729 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.117828 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.118033 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.118125 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.118352 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.118536 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.118674 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.118765 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.118981 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.119074 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.119290 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.119385 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.119601 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.119694 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.119900 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.119986 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.120212 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.120306 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.120516 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.120618 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.120831 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.120916 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.121136 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.121242 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.121455 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.121550 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.121762 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.121861 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.122698 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.123055 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.123136 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.123231 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.123312 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.123395 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.123606 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.123694 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.123925 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.124013 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.124236 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.124322 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.124548 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.124643 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.124856 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.124952 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.125161 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.125254 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.125476 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.125563 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.125781 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.125868 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.126095 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.126180 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.126421 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.126513 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.126727 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.126823 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.127032 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.127119 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.127337 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.127496 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.127639 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.127726 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.127944 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.128029 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.128252 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.128348 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.128564 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.128658 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.128872 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.128958 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.129178 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.129273 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.129487 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.129613 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.129790 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.129877 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.130098 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.130192 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.130426 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.130515 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.130727 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.130813 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.131026 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.131139 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.131326 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.131422 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.131624 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.131709 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.131921 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.132016 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.132225 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.132310 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.132525 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.132611 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.132831 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.132924 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.133153 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.133239 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.133451 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.133536 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.133755 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.133843 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.134060 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.134146 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.134381 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.134470 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.134683 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.134777 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.134988 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.135073 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.135289 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.135383 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.135588 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.135674 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.135891 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.135976 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.136192 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.136290 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.136486 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.136583 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.136801 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.136887 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.137099 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.137197 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.137397 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.138619 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.138724 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.138805 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.138896 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.138992 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.139072 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.139218 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.139306 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.139530 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.139629 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.139842 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.139958 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.140146 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.140236 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.140451 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.140545 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.140768 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.140853 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.141080 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.141165 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.141380 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.141513 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.141698 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.141806 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.142015 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.142112 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.142314 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.142454 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.142632 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.142719 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.142942 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.143036 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.143254 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.143468 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.143563 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.143643 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.143819 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.143906 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.144120 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.144207 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.144414 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.144501 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.144709 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.144795 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.145003 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.145090 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.145297 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.145383 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.145591 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.145677 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.145886 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.145979 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.146184 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.146279 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.146502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.146603 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.146803 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.146897 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.147100 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.147193 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.147397 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.147500 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.147703 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.147790 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.148002 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.148088 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.148338 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.148433 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.148640 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.148727 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.148954 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.149040 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.149259 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.149353 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.149569 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.149662 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.149871 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.149957 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.150175 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.150262 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.150504 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.150594 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.150809 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.150896 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.151116 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.151204 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.151418 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.151569 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.151724 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.151811 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.152025 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.152111 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.152334 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.152419 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.152635 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.152720 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.152946 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.153032 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.153272 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.153705 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.153789 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.153881 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.153962 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.154039 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.154204 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.154293 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.154538 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.154639 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.154851 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.154938 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.155155 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.155241 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.155463 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.155558 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.155764 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.155851 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.156067 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.156162 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.156371 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.156471 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.156673 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.156759 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.156980 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.157067 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.157280 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.157382 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.157587 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.157681 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.157885 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.157970 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.158199 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.158293 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.158524 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.158611 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.158833 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.158917 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.159126 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.159213 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.159432 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.159527 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.159748 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.159836 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.160049 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.160136 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.160358 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.160443 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.160663 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.160750 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.160977 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.161063 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.161281 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.161375 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.161586 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.161685 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.161889 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.161982 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.162185 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.162271 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.162515 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.162612 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.162822 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.162915 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.163123 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.163208 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.163423 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.163521 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.163725 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.163811 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.164023 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.164109 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.164327 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.164469 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.164628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.164714 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.164924 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.165018 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.165219 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.165307 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.165522 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.165608 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.165821 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.165917 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.166120 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.166206 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.166452 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.166542 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.166764 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.166849 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.167063 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.167150 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.167362 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.167448 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.167676 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.167770 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.167975 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.168069 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.168270 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.168355 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.168569 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.168665 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.168930 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.169346 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.169445 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.169525 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.169602 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.169690 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.169837 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.169934 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.170146 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.170233 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.170485 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.170587 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.170794 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.170880 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.171103 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.171188 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.171407 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.171571 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.171712 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.171799 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.172025 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.172110 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.172328 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.172413 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.172634 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.172719 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.172937 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.173022 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.173240 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.173327 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.173542 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.173626 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.173843 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.173938 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.174148 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.174233 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.174472 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.174574 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.174778 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.174865 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.175083 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.175170 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.175380 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.175473 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.175684 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.175778 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.175989 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.176075 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.176289 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.176543 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.176636 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.176871 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.176965 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.177182 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.177438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.177523 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.177774 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.177868 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.178088 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.178189 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.178431 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.178520 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.178758 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.178843 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.179064 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.179170 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.179363 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.179450 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.179668 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.179754 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.179965 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.180058 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.180263 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.180350 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.180565 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.180659 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.180860 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.180956 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.181159 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.181254 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.181455 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.181542 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.181753 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.181898 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.182047 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.182141 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.182382 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.182474 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.182664 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.182760 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.182959 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.183046 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.183259 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.183345 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.183553 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.183639 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.183851 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.183943 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.184145 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.184231 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.184996 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.185456 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.185563 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.185647 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.185725 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.185801 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.185890 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.186044 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.186186 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.186362 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.186514 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.186703 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.186806 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.187001 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.187086 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.187332 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.187426 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.187653 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.187739 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.187989 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.188074 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.188290 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.188374 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.188589 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.188683 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.188903 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.188987 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.189202 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.189286 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.189499 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.189596 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.189795 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.189879 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.190097 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.190189 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.190427 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.190513 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.190724 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.190807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.191024 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.191120 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.191323 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.191416 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.191623 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.191708 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.191923 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.192015 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.192216 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.192300 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.192516 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.192600 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.192813 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.192911 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.193116 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.193200 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.193413 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.193501 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.193708 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.193801 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.194004 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.194088 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.194302 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.194465 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.194622 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.194709 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.194930 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.195014 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.195232 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.195315 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.195530 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.195615 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.195835 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.195920 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.196130 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.196220 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.196426 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.196511 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.196720 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.196805 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.197018 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.197109 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.197316 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.197400 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.197610 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.197695 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.197912 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.198005 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.198214 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.198297 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.198535 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.198613 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.201930 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.202107 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.202219 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.202323 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.202470 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.202616 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.202719 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.202834 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.202938 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.203039 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.203139 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.203241 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.203350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.203460 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.203569 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.203671 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.203771 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.203872 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.203984 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.204087 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.204188 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.204319 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.204402 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.204480 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.204564 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.204642 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.204717 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.204793 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.204868 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.204944 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.205028 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.205106 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.205181 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.205265 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.205342 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.205431 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.205509 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.205586 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.205662 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.205738 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.205813 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.205897 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.205981 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.206058 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.206133 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.206209 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.206284 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.206412 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.206506 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.206715 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.206799 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.207055 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.207185 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.207356 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.207442 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.207684 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.207768 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.207993 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.208086 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.208301 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.208387 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.208611 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.208695 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.208910 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.209008 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.209220 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.209330 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.209522 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.209632 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.209826 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.209950 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.210119 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.210228 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.210439 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.210554 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.210754 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.210879 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.211055 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.211165 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.211356 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.211466 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.211667 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.211790 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.211976 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.212086 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.212287 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.212407 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.212581 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.212692 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.212889 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.213000 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.213192 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.213303 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.213492 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.213605 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.214201 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.214321 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.214430 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.214524 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.214604 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.214680 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.214756 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.214832 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.214976 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.215070 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.215278 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.215372 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.215579 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.215688 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.215915 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.216200 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.216287 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.216508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.216600 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.216806 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.216900 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.217112 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.217202 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.217411 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.217495 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.217706 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.217799 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.218006 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.218089 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.218300 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.218439 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.218626 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.218720 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.218925 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.219016 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.219235 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.219347 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.219540 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.219653 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.219849 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.219956 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.220150 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.220253 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.220810 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.220900 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.221113 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.221197 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.221420 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.221509 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.221721 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.221814 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.222016 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.222106 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.222323 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.222455 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.222653 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.222766 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.222965 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.223076 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.223267 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.223380 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.223677 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.223801 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.223972 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.224064 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.224274 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.224436 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.224579 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.224663 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.224874 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.224964 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.225172 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.225264 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.225467 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.225551 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.225779 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.225863 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.226075 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.226209 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.226395 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.226482 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.226697 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.226805 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.227016 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.227108 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.227316 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.227447 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.227634 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.227785 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.228045 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.228138 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.228354 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.228438 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.228657 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.228740 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.228979 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.229082 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.229295 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.229381 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.229591 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.229695 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.229895 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.229980 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.230199 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.230284 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.230548 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.230634 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.230862 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.230947 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.231166 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.233031 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.233031 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.233181 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.233265 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.233343 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.233429 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.233507 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.233583 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.233647 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.233722 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.233810 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.233889 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.233954 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.234025 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.234025 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.234155 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.234240 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.234318 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.234452 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.234583 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.234583 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.234741 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.234899 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.234980 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.235150 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.235238 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.235449 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.235548 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.235755 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.235840 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.236054 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.236138 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.236357 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.236449 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.236674 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.236766 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.236974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.237066 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.237279 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.237372 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.237583 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.237677 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.237882 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.237965 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.238178 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.238275 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.238501 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.238588 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.238810 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.238894 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.239104 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.239188 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.239401 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.239492 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.239708 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.239793 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.240005 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.240095 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.240324 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.240407 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.240622 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.240714 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.240938 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.241024 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.241240 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.241324 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.241536 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.241627 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.241834 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.241919 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.242133 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.242216 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.242464 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.242564 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.242770 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.242862 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.243074 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.243159 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.243403 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.243494 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.243704 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.243796 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.244017 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.244104 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.244339 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.244435 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.244661 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.244745 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.244970 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.245053 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.245270 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.245364 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.245581 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.245666 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.245899 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.245991 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.246197 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.246290 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.246522 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.246608 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.246827 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.247447 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.247676 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.247753 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.247977 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.248070 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.248279 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.248363 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.248578 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.248678 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.248873 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.248965 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.249168 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.249253 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.249463 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.249549 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.249761 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.249853 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.250061 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.250154 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.250385 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.250485 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.250688 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.250780 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.250986 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.251080 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.251287 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.251371 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.251586 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.251670 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.251885 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.251980 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.252188 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.252274 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.252488 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.252581 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.252801 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.252898 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.253110 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.253194 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.253419 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.253503 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.253730 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.253816 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.254043 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.254177 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.254369 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.254456 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.254683 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.254777 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.254993 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.255077 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.255301 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.255385 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.255605 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.255689 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.255915 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.255999 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.256224 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.256307 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.256529 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.256621 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.256841 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.257064 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.257155 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.257387 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.257473 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.257695 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.257983 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.258070 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.258291 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.258441 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.258621 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.258707 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.258928 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.259014 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.259233 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.259327 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.259537 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.259692 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.259841 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.259935 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.260146 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.260241 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.260454 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.260539 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.260762 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.260855 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.261070 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.261156 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.261393 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.261488 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.261705 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.261797 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.262015 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.262100 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.262342 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.262484 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.263212 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.263315 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.263530 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.263666 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.263843 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.263929 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.264143 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.264344 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.264454 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.264539 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.264762 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.264847 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.265068 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.265154 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.265371 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.265456 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.265675 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.265760 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.265984 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.266069 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.266288 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.266402 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.266615 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.266700 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.266920 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.267007 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.267225 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.267317 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.267531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.267623 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.267839 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.267967 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.268151 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.268246 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.268462 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.268554 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.268773 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.268865 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.269081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.269166 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.269389 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.269482 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.269707 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.269896 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.270022 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.270202 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.270370 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.270558 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.270869 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.270954 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.271182 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.271267 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.271490 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.271581 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.271799 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.271884 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.272119 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.272204 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.272419 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.272506 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.272717 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.272809 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.273023 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.273107 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.273330 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.273421 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.273627 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.273717 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.273933 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.274025 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.274236 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.274377 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.274558 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.274871 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.275174 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.275695 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.276038 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.276348 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.276666 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.276982 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.277292 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.277594 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.277911 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.278353 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.278556 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.278652 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.278958 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.279263 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.279563 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.279863 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.280168 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.280471 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.280770 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.281075 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.281167 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.281374 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.281694 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.281993 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.282292 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.282619 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.282926 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.283229 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.283527 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.283825 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.283918 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.284123 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.284217 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.284428 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.284512 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.284725 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.284817 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.285039 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.285323 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.285410 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.285625 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.285724 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.285972 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.286058 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.286274 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.286397 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.286597 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.286721 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.286912 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.287055 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.287211 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.287373 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.287507 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.287706 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.287818 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.288020 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.288142 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.288333 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.288425 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.288658 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.288743 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.288973 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.289065 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.289283 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.289375 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.289593 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.289678 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.289906 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.290126 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.290211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.290535 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.290623 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.290853 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.290938 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.291157 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.291241 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.291487 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.291572 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.291784 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.291867 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.292082 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.292175 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.292381 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.292466 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.292691 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.292789 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.292994 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.293093 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.293297 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.293397 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.293623 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.294075 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.294489 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.294806 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.295110 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.295415 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.295719 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.296022 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.296324 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.296627 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.296927 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.297227 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.297318 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.297536 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.297870 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.298183 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.298526 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.298835 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.299146 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.299450 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.299754 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.300056 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.300359 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.300449 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.300668 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.300754 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.300989 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.301078 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.301294 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.301379 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.301593 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.301686 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.301987 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.302267 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.302488 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.302613 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.302843 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.302942 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.303180 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.303266 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.303503 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.303587 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.303819 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.303914 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.304134 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.304220 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.304439 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.304523 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.304754 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.304853 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.305057 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.305181 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.305377 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.305470 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.305708 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.305801 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.306028 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.306119 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.306385 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.306486 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.306667 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.306933 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.307019 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.307250 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.307341 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.307552 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.307646 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.307862 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.307948 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.308165 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.308250 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.308461 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.308547 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.308759 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.308844 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.309061 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.309147 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.309884 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.309980 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.310272 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.310360 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.310604 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.310679 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.310905 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.310992 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.311210 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.311296 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.311508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.311592 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.311808 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.311894 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.312113 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.312218 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.312397 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.312496 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.312693 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.312779 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.312988 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.313074 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.313289 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.313384 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.313588 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.313679 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.313887 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.313971 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.314182 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.314274 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.314502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.314589 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.314800 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.314884 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.315126 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.315212 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.315453 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.315538 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.315761 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.315853 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.316077 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.316169 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.316378 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.316462 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.316691 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.316781 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.316992 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.317082 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.317301 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.317385 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.317610 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.317694 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.317964 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.318055 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.318222 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.318307 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.318550 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.318650 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.318859 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.319166 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.319250 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.319470 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.319554 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.319771 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.319864 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.320072 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.320164 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.320371 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.320456 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.320688 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.320775 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.321005 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.321090 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.321305 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.321398 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.321618 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.321704 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.321925 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.322011 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.322240 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.322355 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.322577 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.322780 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.322964 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.323142 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.323312 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.323501 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.324606 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.324691 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.324769 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.324854 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.324931 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.325017 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.325109 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.325677 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.325744 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.325807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.325879 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.325945 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.326008 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.326071 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.326133 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.326350 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.326443 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.326660 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.326746 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.326966 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.327051 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.327272 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.327365 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.327580 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.327664 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.327885 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.327979 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.328195 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.328281 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.328497 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.328581 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.328803 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.328887 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.329106 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.329245 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.329408 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.329495 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.329711 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.329796 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.330013 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.330108 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.330320 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.330434 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.330602 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 13:53:24.330767 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.330933 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.331234 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.331537 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.331836 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.332173 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.332503 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.332818 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.333138 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.333448 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.333768 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.334077 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.334424 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.334745 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.335061 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.335371 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.335701 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.336009 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.336320 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.336632 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.336939 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.337246 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.337554 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.337879 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.338200 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.338533 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.338855 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.339168 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.339487 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.339798 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.340106 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.340431 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.340795 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.341237 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.341548 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.341858 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.342173 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.342518 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.342831 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.343142 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.343458 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.343772 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.344099 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.344424 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.344732 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.345055 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.345635 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.345986 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.346297 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.346660 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.346987 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.347299 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.347613 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.347916 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:53:24.348156 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 13:53:24.484698 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO dbcounter [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Registered counter for database nova_api Sep 23 13:53:24.502766 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO dbcounter [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] Registered counter for database nova_api Sep 23 13:53:24.505843 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_db.sqlalchemy.engines [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 13:53:24.512612 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writer thread running {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 13:53:24.523288 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG oslo_db.sqlalchemy.engines [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 13:53:24.529984 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG dbcounter [-] [105867] Writer thread running {{(pid=105867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 13:53:24.569733 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.context [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9b62a15-663d-4061-af73-b76bf6ffc81b(cell1) {{(pid=105868) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 13:53:24.573518 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 13:53:24.573992 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 13:53:24.575579 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 13:53:24.576297 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 13:53:24.576742 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 13:53:24.578727 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 13:53:24.580715 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO dbcounter [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Registered counter for database nova_cell0 Sep 23 13:53:24.585009 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO dbcounter [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Registered counter for database nova_cell1 Sep 23 13:53:24.586877 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.context [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9b62a15-663d-4061-af73-b76bf6ffc81b(cell1) {{(pid=105867) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 13:53:24.590738 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG oslo_concurrency.lockutils [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 13:53:24.591217 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG oslo_concurrency.lockutils [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 13:53:24.592790 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG oslo_concurrency.lockutils [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 13:53:24.592937 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_db.sqlalchemy.engines [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 13:53:24.593544 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG oslo_concurrency.lockutils [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 13:53:24.593985 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG oslo_concurrency.lockutils [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 13:53:24.594427 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_db.sqlalchemy.engines [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 13:53:24.596263 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG oslo_concurrency.lockutils [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 13:53:24.598297 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO dbcounter [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] Registered counter for database nova_cell0 Sep 23 13:53:24.600707 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writer thread running {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 13:53:24.602361 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO dbcounter [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] Registered counter for database nova_cell1 Sep 23 13:53:24.603381 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writer thread running {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 13:53:24.609619 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG oslo_db.sqlalchemy.engines [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 13:53:24.611283 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG oslo_db.sqlalchemy.engines [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 13:53:24.617078 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG dbcounter [-] [105867] Writer thread running {{(pid=105867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 13:53:24.619340 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG dbcounter [-] [105867] Writer thread running {{(pid=105867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 13:53:24.747673 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO dbcounter [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Registered counter for database nova_cell0 Sep 23 13:53:24.756752 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_db.sqlalchemy.engines [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 13:53:24.761002 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writer thread running {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 13:53:24.763259 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO dbcounter [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] Registered counter for database nova_cell0 Sep 23 13:53:24.771823 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG oslo_db.sqlalchemy.engines [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 13:53:24.776420 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG dbcounter [-] [105867] Writer thread running {{(pid=105867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 13:53:25.193883 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: WARNING keystonemiddleware.auth_token [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 13:53:25.201395 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: WARNING keystonemiddleware.auth_token [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 13:53:25.249957 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: WARNING keystonemiddleware.auth_token [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 13:53:25.257329 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: WARNING keystonemiddleware.auth_token [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 13:53:25.551194 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: WARNING keystonemiddleware.auth_token [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 13:53:25.557174 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: WARNING keystonemiddleware.auth_token [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 13:53:25.563148 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aef7f629c0 pid: 105868 (default app) Sep 23 13:53:25.565177 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:53:25.566367 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001693 Sep 23 13:53:25.566798 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Fri Sep 23 13:53:25 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:53:25.602241 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: WARNING keystonemiddleware.auth_token [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 13:53:25.608789 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: WARNING keystonemiddleware.auth_token [None req-250cbb4e-0f10-4ecd-9786-bd5cf94bb25d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 13:53:25.614074 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aef7f629c0 pid: 105867 (default app) Sep 23 13:54:50.566407 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:54:50.567365 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 23 13:54:50.567766 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 23 13:54:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 13:54:50.580042 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG dbcounter [-] [105867] Writing DB stats nova_api:SELECT=3 {{(pid=105867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:50.581958 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG dbcounter [-] [105867] Writing DB stats nova_cell0:SELECT=3 {{(pid=105867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:50.582904 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG dbcounter [-] [105867] Writing DB stats nova_cell1:SELECT=3 {{(pid=105867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:50.583996 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG dbcounter [-] [105867] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:51.443506 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-b3f2f3df-8d4e-4e65-acc0-bb7eeb115ad3 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:54:51.477249 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-b3f2f3df-8d4e-4e65-acc0-bb7eeb115ad3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.902509 Sep 23 13:54:51.482372 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1292 bytes} [Fri Sep 23 13:54:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 13:54:54.175119 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:54:54.176183 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-7d0c7421-658f-437c-a502-a834f8e86916 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Sep 23 13:54:54.177188 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 23 13:54:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:54:54.643830 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-d99dff89-bd81-4653-9025-eb2743ea8a62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "name": "cirros256", "id": "c1", "disk": 1}} {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:54:54.747190 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-d99dff89-bd81-4653-9025-eb2743ea8a62 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.563519 Sep 23 13:54:54.747980 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 23 13:54:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 13:54:54.762621 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writing DB stats nova_api:SELECT=3 {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:54.763393 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writing DB stats nova_cell1:SELECT=3 {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:54.765297 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writing DB stats nova_cell0:SELECT=3 {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:54.766071 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:54.972585 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-fd1d6507-760e-408c-83c3-57999a406324 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:54:55.089303 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-fd1d6507-760e-408c-83c3-57999a406324 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.333187 Sep 23 13:54:55.090763 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1336 bytes} [Fri Sep 23 13:54:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 13:54:57.705887 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-d99dff89-bd81-4653-9025-eb2743ea8a62 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:54:57.706935 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-d99dff89-bd81-4653-9025-eb2743ea8a62 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 23 13:54:57.707597 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 23 13:54:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:54:58.367281 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-012f48b6-2534-4ec9-bd69-65bb949d466a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "swap": 0, "id": "d1"}} {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:54:58.497731 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-012f48b6-2534-4ec9-bd69-65bb949d466a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.783790 Sep 23 13:54:58.498513 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 23 13:54:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 13:54:58.510641 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-dc05f16d-2b94-4780-b94f-887d49098a9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:54:58.609693 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-dc05f16d-2b94-4780-b94f-887d49098a9c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103139 Sep 23 13:54:58.610429 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1336 bytes} [Fri Sep 23 13:54:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 13:55:01.224885 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-012f48b6-2534-4ec9-bd69-65bb949d466a admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:01.225942 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-012f48b6-2534-4ec9-bd69-65bb949d466a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 23 13:55:01.226545 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 23 13:55:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:01.649108 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-834542d0-21a0-451e-b8ca-31c79b8ea528 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "id": "d2", "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:01.764515 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-834542d0-21a0-451e-b8ca-31c79b8ea528 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.531082 Sep 23 13:55:01.765260 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 23 13:55:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 13:55:01.777060 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-0aee6792-3b07-4f79-85a1-f7214e79b81d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:01.906062 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-0aee6792-3b07-4f79-85a1-f7214e79b81d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132542 Sep 23 13:55:01.906720 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1336 bytes} [Fri Sep 23 13:55:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 13:55:04.608162 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-834542d0-21a0-451e-b8ca-31c79b8ea528 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:04.609165 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-834542d0-21a0-451e-b8ca-31c79b8ea528 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Sep 23 13:55:04.609732 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 23 13:55:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:05.039215 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-d3ee30be-7e71-4b0c-a000-5d2b16abf6e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:05.138689 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-d3ee30be-7e71-4b0c-a000-5d2b16abf6e2 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.522804 Sep 23 13:55:05.139349 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 23 13:55:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 13:55:05.152272 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-f0928a5e-cb16-44da-bcbf-bdfd53ca195f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:05.245018 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-f0928a5e-cb16-44da-bcbf-bdfd53ca195f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097202 Sep 23 13:55:05.245850 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1336 bytes} [Fri Sep 23 13:55:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 13:55:07.896548 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-d3ee30be-7e71-4b0c-a000-5d2b16abf6e2 admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:07.897544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-d3ee30be-7e71-4b0c-a000-5d2b16abf6e2 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 23 13:55:07.898381 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 23 13:55:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:08.365119 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-087b2a82-06e7-414e-9039-0b1b89bad741 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "ram": 4096}} {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:08.438316 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-087b2a82-06e7-414e-9039-0b1b89bad741 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529785 Sep 23 13:55:08.438891 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 23 13:55:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 13:55:08.451671 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-94864033-5c56-4144-ad5f-dbbb570212b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:08.547872 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-94864033-5c56-4144-ad5f-dbbb570212b2 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099659 Sep 23 13:55:08.548730 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1336 bytes} [Fri Sep 23 13:55:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 13:55:11.313300 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-087b2a82-06e7-414e-9039-0b1b89bad741 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:11.314312 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-087b2a82-06e7-414e-9039-0b1b89bad741 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Sep 23 13:55:11.314799 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 23 13:55:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:11.777130 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-402e9bbe-e312-4e20-8301-0f32404eda19 admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:11.802138 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-402e9bbe-e312-4e20-8301-0f32404eda19 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.479689 Sep 23 13:55:11.803658 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1292 bytes} [Fri Sep 23 13:55:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 13:55:14.637805 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-087b2a82-06e7-414e-9039-0b1b89bad741 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:14.638784 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-087b2a82-06e7-414e-9039-0b1b89bad741 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 23 13:55:14.639186 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 23 13:55:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:15.042700 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-477c3d8d-175a-4781-a0c4-07232d594ce9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1"}} {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:15.138238 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-477c3d8d-175a-4781-a0c4-07232d594ce9 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.492955 Sep 23 13:55:15.138807 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 23 13:55:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 13:55:15.151408 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-b35a5e8b-b956-4708-ac8f-54e46d30f77c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:15.235018 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-b35a5e8b-b956-4708-ac8f-54e46d30f77c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087772 Sep 23 13:55:15.235777 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1333 bytes} [Fri Sep 23 13:55:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 13:55:17.860832 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-477c3d8d-175a-4781-a0c4-07232d594ce9 admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:17.861842 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-477c3d8d-175a-4781-a0c4-07232d594ce9 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 23 13:55:17.862239 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 23 13:55:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:18.230548 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-fbb375cf-3d85-4851-843f-aa05e6ca8681 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "id": "2", "swap": 0, "name": "m1.small"}} {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:18.322781 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-fbb375cf-3d85-4851-843f-aa05e6ca8681 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.454327 Sep 23 13:55:18.323340 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 23 13:55:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 13:55:18.335213 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-3b87f182-0021-41b4-bded-88d83a61159c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:18.418512 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-3b87f182-0021-41b4-bded-88d83a61159c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086892 Sep 23 13:55:18.419515 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1333 bytes} [Fri Sep 23 13:55:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 13:55:21.115942 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-fbb375cf-3d85-4851-843f-aa05e6ca8681 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:21.118383 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-fbb375cf-3d85-4851-843f-aa05e6ca8681 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002604 Sep 23 13:55:21.119341 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 23 13:55:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:21.621911 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-3795be8a-d135-4278-adca-c60ac8478236 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:21.715007 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-3795be8a-d135-4278-adca-c60ac8478236 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.589335 Sep 23 13:55:21.715791 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 23 13:55:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 13:55:21.727337 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-21b5b4bf-525a-44e8-9fca-082b29c232f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:21.732506 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG dbcounter [-] [105867] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:55:21.841353 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-21b5b4bf-525a-44e8-9fca-082b29c232f2 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117519 Sep 23 13:55:21.841972 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1333 bytes} [Fri Sep 23 13:55:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 13:55:24.463131 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-3795be8a-d135-4278-adca-c60ac8478236 admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:24.464403 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-3795be8a-d135-4278-adca-c60ac8478236 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001747 Sep 23 13:55:24.464804 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 23 13:55:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:24.892536 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-b4cb1b92-8768-4bae-8b42-9b15819327c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192, "disk": 80, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:24.991045 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-b4cb1b92-8768-4bae-8b42-9b15819327c6 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.519217 Sep 23 13:55:24.992390 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 23 13:55:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 13:55:25.004590 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-8d7d9cfc-40ae-48b4-bffb-5113b9216e3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:25.096858 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writing DB stats nova_api:SELECT=43,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:55:25.100693 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-8d7d9cfc-40ae-48b4-bffb-5113b9216e3b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100014 Sep 23 13:55:25.101541 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1333 bytes} [Fri Sep 23 13:55:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 13:55:27.742544 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-b4cb1b92-8768-4bae-8b42-9b15819327c6 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:27.743546 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-b4cb1b92-8768-4bae-8b42-9b15819327c6 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002156 Sep 23 13:55:27.743943 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 23 13:55:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:28.177821 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-bfc23f3a-5eb1-4adb-a549-cb542db6e39c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "id": "5", "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8}} {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:28.270876 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-bfc23f3a-5eb1-4adb-a549-cb542db6e39c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.520735 Sep 23 13:55:28.271604 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 23 13:55:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 13:55:28.285480 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-d32c3b59-86f9-41cf-a669-4dca765b692c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:28.369180 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-d32c3b59-86f9-41cf-a669-4dca765b692c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087388 Sep 23 13:55:28.369813 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1333 bytes} [Fri Sep 23 13:55:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 13:55:46.189979 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-bfc23f3a-5eb1-4adb-a549-cb542db6e39c admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:46.190957 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-bfc23f3a-5eb1-4adb-a549-cb542db6e39c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Sep 23 13:55:46.191355 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 23 13:55:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:46.201988 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG dbcounter [-] [105867] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:55:46.581046 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-47813d33-7f90-455a-8bf4-4875a794ab2a admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:46.599868 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-47813d33-7f90-455a-8bf4-4875a794ab2a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402340 Sep 23 13:55:46.600398 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1292 bytes} [Fri Sep 23 13:55:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 13:55:47.907409 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-bfc23f3a-5eb1-4adb-a549-cb542db6e39c admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:47.908416 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-bfc23f3a-5eb1-4adb-a549-cb542db6e39c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Sep 23 13:55:47.908816 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 23 13:55:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:48.429927 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-6c45aa6a-16f4-4209-89d9-8ddf9c7ab6e6 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:48.435438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.wsgi [None req-6c45aa6a-16f4-4209-89d9-8ddf9c7ab6e6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-6c45aa6a-16f4-4209-89d9-8ddf9c7ab6e6 admin admin] Request method failure captured: Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Accept: application/json Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Accept-Encoding: gzip, deflate Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Connection: keep-alive Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Content-Length: 0 Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Host: 10.222.0.62 Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Openstack-Api-Version: compute 2.92 Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Openstack-System-Scope: None Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: User-Agent: python-novaclient Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Auth-Token: gAAAAABjLbrjSjFNWlAttPDR2VXUSNdmfXCWPU9v4tvqNeXCVK9F6GKJl0sDoTm4Lat2QAfm6cJcIc4djmXx92eGcozQ7xREOOrFRMCuMAQnn_M0JaydgiiM02Un8stCmAHA58a08qaiu3KgKSiaLcF3H9aACNk2r8ORcEEJatMt8iLFitB7gVY Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Domain-Id: None Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Domain-Name: None Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Identity-Status: Confirmed Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Is-Admin-Project: True Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Project-Domain-Id: default Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Project-Domain-Name: Default Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Project-Id: e15d4d7f53c543e88cdf9075fbadb3c8 Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Project-Name: admin Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Role: reader,member,admin Sep 23 13:55:48.438651 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Roles: reader,member,admin Sep 23 13:55:48.440211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e15d4d7f53c543e88cdf9075fbadb3c8"}]}] Sep 23 13:55:48.440211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Tenant: admin Sep 23 13:55:48.440211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Tenant-Id: e15d4d7f53c543e88cdf9075fbadb3c8 Sep 23 13:55:48.440211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Tenant-Name: admin Sep 23 13:55:48.440211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User: admin Sep 23 13:55:48.440211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User-Domain-Id: default Sep 23 13:55:48.440211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User-Domain-Name: Default Sep 23 13:55:48.440211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User-Id: 2ea3af238714467ab48e451a5210c19f Sep 23 13:55:48.440211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User-Name: admin Sep 23 13:55:48.440211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: method: > Sep 23 13:55:48.440211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: exception: Flavor 42 could not be found. Sep 23 13:55:48.440211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: action_args: {'id': '42'} Sep 23 13:55:48.440211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 13:55:48.440211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 13:55:48.441081 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:48.442481 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-6c45aa6a-16f4-4209-89d9-8ddf9c7ab6e6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 13:55:48.443593 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-6c45aa6a-16f4-4209-89d9-8ddf9c7ab6e6 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.390273 Sep 23 13:55:48.443593 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Fri Sep 23 13:55:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 13:55:48.450591 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-c8076b5b-a425-478d-af61-6873ba924d20 admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:48.454775 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writing DB stats nova_api:SELECT=4,nova_api:INSERT=1 {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:55:48.474278 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-c8076b5b-a425-478d-af61-6873ba924d20 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027340 Sep 23 13:55:48.474851 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Fri Sep 23 13:55:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 13:55:48.485553 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-2bf666c5-b35f-4c9b-9e64-e3166b820c62 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:48.508023 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-2bf666c5-b35f-4c9b-9e64-e3166b820c62 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026391 Sep 23 13:55:48.508565 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Fri Sep 23 13:55:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 13:55:48.518119 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-f7d366b3-3327-4ccd-9209-e9b7c126339d admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:48.524099 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.wsgi [None req-f7d366b3-3327-4ccd-9209-e9b7c126339d admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-f7d366b3-3327-4ccd-9209-e9b7c126339d admin admin] Request method failure captured: Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Accept: application/json Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Accept-Encoding: gzip, deflate Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Connection: keep-alive Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Content-Length: 0 Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Host: 10.222.0.62 Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Openstack-Api-Version: compute 2.92 Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Openstack-System-Scope: None Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: User-Agent: python-novaclient Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Auth-Token: gAAAAABjLbrjSjFNWlAttPDR2VXUSNdmfXCWPU9v4tvqNeXCVK9F6GKJl0sDoTm4Lat2QAfm6cJcIc4djmXx92eGcozQ7xREOOrFRMCuMAQnn_M0JaydgiiM02Un8stCmAHA58a08qaiu3KgKSiaLcF3H9aACNk2r8ORcEEJatMt8iLFitB7gVY Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Domain-Id: None Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Domain-Name: None Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Identity-Status: Confirmed Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Is-Admin-Project: True Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Project-Domain-Id: default Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Project-Domain-Name: Default Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Project-Id: e15d4d7f53c543e88cdf9075fbadb3c8 Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Project-Name: admin Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Role: reader,member,admin Sep 23 13:55:48.527628 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Roles: reader,member,admin Sep 23 13:55:48.534090 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e15d4d7f53c543e88cdf9075fbadb3c8"}]}] Sep 23 13:55:48.534090 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Tenant: admin Sep 23 13:55:48.534090 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Tenant-Id: e15d4d7f53c543e88cdf9075fbadb3c8 Sep 23 13:55:48.534090 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Tenant-Name: admin Sep 23 13:55:48.534090 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User: admin Sep 23 13:55:48.534090 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User-Domain-Id: default Sep 23 13:55:48.534090 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User-Domain-Name: Default Sep 23 13:55:48.534090 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User-Id: 2ea3af238714467ab48e451a5210c19f Sep 23 13:55:48.534090 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User-Name: admin Sep 23 13:55:48.534090 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: method: > Sep 23 13:55:48.534090 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: exception: Flavor 42 could not be found. Sep 23 13:55:48.534090 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: action_args: {'id': '42'} Sep 23 13:55:48.534090 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 13:55:48.534090 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 13:55:48.535093 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:48.536350 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-f7d366b3-3327-4ccd-9209-e9b7c126339d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 13:55:48.537537 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-f7d366b3-3327-4ccd-9209-e9b7c126339d admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014694 Sep 23 13:55:48.537537 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Fri Sep 23 13:55:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 13:55:49.733233 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-2bf666c5-b35f-4c9b-9e64-e3166b820c62 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:49.734247 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-2bf666c5-b35f-4c9b-9e64-e3166b820c62 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 23 13:55:49.734675 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 23 13:55:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:50.389360 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-7c12f72b-7d1d-4379-a262-93c5611a3e78 admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:50.394423 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.wsgi [None req-7c12f72b-7d1d-4379-a262-93c5611a3e78 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-7c12f72b-7d1d-4379-a262-93c5611a3e78 admin admin] Request method failure captured: Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Accept: application/json Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Accept-Encoding: gzip, deflate Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Connection: keep-alive Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Content-Length: 0 Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Host: 10.222.0.62 Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Openstack-Api-Version: compute 2.92 Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Openstack-System-Scope: None Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: User-Agent: python-novaclient Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Auth-Token: gAAAAABjLbrl-RolItBdgBfsrcBaQQ_lMIVHgH1KncXVpaOqwcSsCiLA5Ic1L5IkrtMXQf9Bi9cwj1GquxnekRUC9yNm2hRs2M7y2BKLAw6_5tf7MQMd6LgYsdC5bXcVKY7isbB7I2v8dvTuItRRMEUV7ZLrJwbnEEeCdVQyZABqnf7bQyuiu30 Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Domain-Id: None Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Domain-Name: None Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Identity-Status: Confirmed Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Is-Admin-Project: True Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Project-Domain-Id: default Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Project-Domain-Name: Default Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Project-Id: e15d4d7f53c543e88cdf9075fbadb3c8 Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Project-Name: admin Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Role: reader,member,admin Sep 23 13:55:50.395974 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Roles: reader,member,admin Sep 23 13:55:50.397502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e15d4d7f53c543e88cdf9075fbadb3c8"}]}] Sep 23 13:55:50.397502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Tenant: admin Sep 23 13:55:50.397502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Tenant-Id: e15d4d7f53c543e88cdf9075fbadb3c8 Sep 23 13:55:50.397502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Tenant-Name: admin Sep 23 13:55:50.397502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User: admin Sep 23 13:55:50.397502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User-Domain-Id: default Sep 23 13:55:50.397502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User-Domain-Name: Default Sep 23 13:55:50.397502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User-Id: 2ea3af238714467ab48e451a5210c19f Sep 23 13:55:50.397502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User-Name: admin Sep 23 13:55:50.397502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: method: > Sep 23 13:55:50.397502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: exception: Flavor 84 could not be found. Sep 23 13:55:50.397502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: action_args: {'id': '84'} Sep 23 13:55:50.397502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 13:55:50.397502 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 13:55:50.398544 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:50.399838 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-7c12f72b-7d1d-4379-a262-93c5611a3e78 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 13:55:50.401081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-7c12f72b-7d1d-4379-a262-93c5611a3e78 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.524340 Sep 23 13:55:50.401081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Fri Sep 23 13:55:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 525 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 13:55:50.407253 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-25ba3e9d-fd25-48cc-8a16-1e27d34f7a85 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:50.422309 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-25ba3e9d-fd25-48cc-8a16-1e27d34f7a85 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018714 Sep 23 13:55:50.422851 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Fri Sep 23 13:55:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 13:55:50.438067 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-62f3ef60-df0f-4b9f-848a-25aac7bc2995 admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:50.454280 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-62f3ef60-df0f-4b9f-848a-25aac7bc2995 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019847 Sep 23 13:55:50.454848 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Fri Sep 23 13:55:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 13:55:50.464814 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-416d5d30-2696-4af0-98b9-42cf9fcfba82 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:50.469879 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.wsgi [None req-416d5d30-2696-4af0-98b9-42cf9fcfba82 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-416d5d30-2696-4af0-98b9-42cf9fcfba82 admin admin] Request method failure captured: Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Accept: application/json Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Accept-Encoding: gzip, deflate Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Connection: keep-alive Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Content-Length: 0 Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Host: 10.222.0.62 Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Openstack-Api-Version: compute 2.92 Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Openstack-System-Scope: None Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: User-Agent: python-novaclient Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Auth-Token: gAAAAABjLbrl-RolItBdgBfsrcBaQQ_lMIVHgH1KncXVpaOqwcSsCiLA5Ic1L5IkrtMXQf9Bi9cwj1GquxnekRUC9yNm2hRs2M7y2BKLAw6_5tf7MQMd6LgYsdC5bXcVKY7isbB7I2v8dvTuItRRMEUV7ZLrJwbnEEeCdVQyZABqnf7bQyuiu30 Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Domain-Id: None Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Domain-Name: None Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Identity-Status: Confirmed Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Is-Admin-Project: True Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Project-Domain-Id: default Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Project-Domain-Name: Default Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Project-Id: e15d4d7f53c543e88cdf9075fbadb3c8 Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Project-Name: admin Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Role: reader,member,admin Sep 23 13:55:50.471438 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Roles: reader,member,admin Sep 23 13:55:50.472955 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e15d4d7f53c543e88cdf9075fbadb3c8"}]}] Sep 23 13:55:50.472955 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Tenant: admin Sep 23 13:55:50.472955 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Tenant-Id: e15d4d7f53c543e88cdf9075fbadb3c8 Sep 23 13:55:50.472955 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Tenant-Name: admin Sep 23 13:55:50.472955 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User: admin Sep 23 13:55:50.472955 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User-Domain-Id: default Sep 23 13:55:50.472955 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User-Domain-Name: Default Sep 23 13:55:50.472955 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User-Id: 2ea3af238714467ab48e451a5210c19f Sep 23 13:55:50.472955 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User-Name: admin Sep 23 13:55:50.472955 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: method: > Sep 23 13:55:50.472955 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: exception: Flavor 84 could not be found. Sep 23 13:55:50.472955 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: action_args: {'id': '84'} Sep 23 13:55:50.472955 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 13:55:50.472955 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 13:55:50.473913 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:50.475332 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-416d5d30-2696-4af0-98b9-42cf9fcfba82 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 13:55:50.476962 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-416d5d30-2696-4af0-98b9-42cf9fcfba82 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011933 Sep 23 13:55:50.476962 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Fri Sep 23 13:55:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 23 13:55:51.682946 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-62f3ef60-df0f-4b9f-848a-25aac7bc2995 admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:51.684062 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-62f3ef60-df0f-4b9f-848a-25aac7bc2995 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 23 13:55:51.684441 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 23 13:55:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:52.214739 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-b70a8458-9fa1-47c2-a59b-caf2f1f80149 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:52.220726 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.wsgi [None req-b70a8458-9fa1-47c2-a59b-caf2f1f80149 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-b70a8458-9fa1-47c2-a59b-caf2f1f80149 admin admin] Request method failure captured: Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Accept: application/json Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Accept-Encoding: gzip, deflate Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Connection: keep-alive Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Content-Length: 0 Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Host: 10.222.0.62 Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Openstack-Api-Version: compute 2.92 Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Openstack-System-Scope: None Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: User-Agent: python-novaclient Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Auth-Token: gAAAAABjLbrnQHxiQxOQapjveOY2PETgcxYRCuKWJB55_d5AOIMtzmUc1dUY-eScUrYSy1LgZBbnsFuVFP8rUCLO3FosHd5K5Eymxu3ckuaY8W8yxZylLYfhrQYPbxwbbYZ-ee_IH2id35oZMbfYro6YDugvu0snFRkhfmNJsLJF9THqW3PO9Sc Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Domain-Id: None Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Domain-Name: None Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Identity-Status: Confirmed Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Is-Admin-Project: True Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Project-Domain-Id: default Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Project-Domain-Name: Default Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Project-Id: e15d4d7f53c543e88cdf9075fbadb3c8 Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Project-Name: admin Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Role: reader,member,admin Sep 23 13:55:52.222211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Roles: reader,member,admin Sep 23 13:55:52.223807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e15d4d7f53c543e88cdf9075fbadb3c8"}]}] Sep 23 13:55:52.223807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Tenant: admin Sep 23 13:55:52.223807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Tenant-Id: e15d4d7f53c543e88cdf9075fbadb3c8 Sep 23 13:55:52.223807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-Tenant-Name: admin Sep 23 13:55:52.223807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User: admin Sep 23 13:55:52.223807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User-Domain-Id: default Sep 23 13:55:52.223807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User-Domain-Name: Default Sep 23 13:55:52.223807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User-Id: 2ea3af238714467ab48e451a5210c19f Sep 23 13:55:52.223807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: X-User-Name: admin Sep 23 13:55:52.223807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: method: > Sep 23 13:55:52.223807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: exception: Flavor 451 could not be found. Sep 23 13:55:52.223807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: action_args: {'id': '451'} Sep 23 13:55:52.223807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 13:55:52.223807 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 13:55:52.224735 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: ERROR nova.api.openstack.wsgi Sep 23 13:55:52.226531 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-b70a8458-9fa1-47c2-a59b-caf2f1f80149 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 13:55:52.228995 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-b70a8458-9fa1-47c2-a59b-caf2f1f80149 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.401632 Sep 23 13:55:52.228995 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Fri Sep 23 13:55:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 13:55:52.233885 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-362a5f07-0822-44d3-ab9c-090be3943873 admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:52.249069 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-362a5f07-0822-44d3-ab9c-090be3943873 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018686 Sep 23 13:55:52.249594 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Fri Sep 23 13:55:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 13:55:52.259467 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-08e9f0f9-f5b1-4c9c-89b3-cbf54835e119 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:52.274827 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-08e9f0f9-f5b1-4c9c-89b3-cbf54835e119 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019329 Sep 23 13:55:52.275348 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Fri Sep 23 13:55:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 13:55:52.284490 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-e2a7ad37-c35e-47b0-a7f3-df1b2679425e admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:52.289561 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.wsgi [None req-e2a7ad37-c35e-47b0-a7f3-df1b2679425e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-e2a7ad37-c35e-47b0-a7f3-df1b2679425e admin admin] Request method failure captured: Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Accept: application/json Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Accept-Encoding: gzip, deflate Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Connection: keep-alive Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Content-Length: 0 Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Host: 10.222.0.62 Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Openstack-Api-Version: compute 2.92 Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Openstack-System-Scope: None Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: User-Agent: python-novaclient Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Auth-Token: gAAAAABjLbrnQHxiQxOQapjveOY2PETgcxYRCuKWJB55_d5AOIMtzmUc1dUY-eScUrYSy1LgZBbnsFuVFP8rUCLO3FosHd5K5Eymxu3ckuaY8W8yxZylLYfhrQYPbxwbbYZ-ee_IH2id35oZMbfYro6YDugvu0snFRkhfmNJsLJF9THqW3PO9Sc Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Domain-Id: None Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Domain-Name: None Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Identity-Status: Confirmed Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Is-Admin-Project: True Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Project-Domain-Id: default Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Project-Domain-Name: Default Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Project-Id: e15d4d7f53c543e88cdf9075fbadb3c8 Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Project-Name: admin Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Role: reader,member,admin Sep 23 13:55:52.291081 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Roles: reader,member,admin Sep 23 13:55:52.292567 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e15d4d7f53c543e88cdf9075fbadb3c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e15d4d7f53c543e88cdf9075fbadb3c8"}]}] Sep 23 13:55:52.292567 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Tenant: admin Sep 23 13:55:52.292567 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Tenant-Id: e15d4d7f53c543e88cdf9075fbadb3c8 Sep 23 13:55:52.292567 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-Tenant-Name: admin Sep 23 13:55:52.292567 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User: admin Sep 23 13:55:52.292567 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User-Domain-Id: default Sep 23 13:55:52.292567 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User-Domain-Name: Default Sep 23 13:55:52.292567 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User-Id: 2ea3af238714467ab48e451a5210c19f Sep 23 13:55:52.292567 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: X-User-Name: admin Sep 23 13:55:52.292567 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: method: > Sep 23 13:55:52.292567 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: exception: Flavor 451 could not be found. Sep 23 13:55:52.292567 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: action_args: {'id': '451'} Sep 23 13:55:52.292567 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 13:55:52.292567 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 13:55:52.293420 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: ERROR nova.api.openstack.wsgi Sep 23 13:55:52.294508 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-e2a7ad37-c35e-47b0-a7f3-df1b2679425e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 13:55:52.295529 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-e2a7ad37-c35e-47b0-a7f3-df1b2679425e admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011447 Sep 23 13:55:52.295529 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Fri Sep 23 13:55:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 23 13:55:53.516828 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-08e9f0f9-f5b1-4c9c-89b3-cbf54835e119 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:53.517824 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-08e9f0f9-f5b1-4c9c-89b3-cbf54835e119 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Sep 23 13:55:53.518211 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 23 13:55:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:54.037729 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-f53486a6-229f-4eb9-ba29-3b5aafcc4224 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:54.113944 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-f53486a6-229f-4eb9-ba29-3b5aafcc4224 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.452843 Sep 23 13:55:54.114862 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Fri Sep 23 13:55:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 13:55:55.351987 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-08e9f0f9-f5b1-4c9c-89b3-cbf54835e119 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:55.352986 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-08e9f0f9-f5b1-4c9c-89b3-cbf54835e119 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 23 13:55:55.353384 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 23 13:55:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:55.925368 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-eafd7543-a410-4e98-8d17-b612508a2b18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:55.988397 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-eafd7543-a410-4e98-8d17-b612508a2b18 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.494655 Sep 23 13:55:55.988954 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Fri Sep 23 13:55:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 13:55:57.232432 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-08e9f0f9-f5b1-4c9c-89b3-cbf54835e119 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:57.233755 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-08e9f0f9-f5b1-4c9c-89b3-cbf54835e119 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001822 Sep 23 13:55:57.234265 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 23 13:55:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:57.753047 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-506e8c6e-09a3-4237-99fc-3ba7325dd0a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:57.851413 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-506e8c6e-09a3-4237-99fc-3ba7325dd0a8 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.478218 Sep 23 13:55:57.851955 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Fri Sep 23 13:55:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 13:55:59.054499 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-08e9f0f9-f5b1-4c9c-89b3-cbf54835e119 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:55:59.055499 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-08e9f0f9-f5b1-4c9c-89b3-cbf54835e119 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 23 13:55:59.055886 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 23 13:55:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:55:59.575750 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-3e89e25f-f1d1-4422-accc-691f632cbe01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 13:55:59.650625 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-3e89e25f-f1d1-4422-accc-691f632cbe01 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.457554 Sep 23 13:55:59.651169 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Fri Sep 23 13:55:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 13:56:00.866874 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-08e9f0f9-f5b1-4c9c-89b3-cbf54835e119 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:56:00.868362 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-08e9f0f9-f5b1-4c9c-89b3-cbf54835e119 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Sep 23 13:56:00.868750 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 23 13:56:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:56:01.388217 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-cda30034-4f96-4b0b-8880-cdb7336498dc admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:56:01.408611 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-cda30034-4f96-4b0b-8880-cdb7336498dc admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401820 Sep 23 13:56:01.409060 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Fri Sep 23 13:56:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 13:56:58.319501 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-08e9f0f9-f5b1-4c9c-89b3-cbf54835e119 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:56:58.320535 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-08e9f0f9-f5b1-4c9c-89b3-cbf54835e119 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 23 13:56:58.320932 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 23 13:56:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 13:56:58.331276 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:56:58.713188 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-3e45a35b-a890-4c01-bc03-70dfe6cfb73f admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:56:58.734272 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-3e45a35b-a890-4c01-bc03-70dfe6cfb73f admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407463 Sep 23 13:56:58.734768 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1292 bytes} [Fri Sep 23 13:56:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 13:56:58.755375 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG dbcounter [-] [105867] Writing DB stats nova_api:SELECT=14 {{(pid=105867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:56:58.759195 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-4247ced8-451d-43af-90b9-c11b679b07a7 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:56:58.766266 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-4247ced8-451d-43af-90b9-c11b679b07a7 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012298 Sep 23 13:56:58.766818 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1283 bytes} [Fri Sep 23 13:56:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 13:56:58.779156 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-60231586-6974-4d3f-a36c-58584503dea4 admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:56:58.786987 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-60231586-6974-4d3f-a36c-58584503dea4 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011412 Sep 23 13:56:58.787497 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1286 bytes} [Fri Sep 23 13:56:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 13:56:58.798953 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-d252f866-a87d-4ffd-bb70-c7000ae51448 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:56:58.806150 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-d252f866-a87d-4ffd-bb70-c7000ae51448 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011051 Sep 23 13:56:58.806684 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1286 bytes} [Fri Sep 23 13:56:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 13:56:58.818262 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-81de5e8b-609d-4af4-81b8-ed6a69a91e3a admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 13:56:58.825215 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-81de5e8b-609d-4af4-81b8-ed6a69a91e3a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011036 Sep 23 13:56:58.825714 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1283 bytes} [Fri Sep 23 13:56:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:00:07.975436 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-d252f866-a87d-4ffd-bb70-c7000ae51448 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:00:07.976429 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-d252f866-a87d-4ffd-bb70-c7000ae51448 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 23 14:00:07.976822 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 23 14:00:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:00:08.116649 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writing DB stats nova_api:SELECT=6 {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:08.294311 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-0192ac36-386a-4db3-8e8a-48d3853d8e0e admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:00:08.299006 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-0192ac36-386a-4db3-8e8a-48d3853d8e0e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:00:08.299481 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-0192ac36-386a-4db3-8e8a-48d3853d8e0e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:00:08.299905 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-0192ac36-386a-4db3-8e8a-48d3853d8e0e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:00:08.300611 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-0192ac36-386a-4db3-8e8a-48d3853d8e0e admin admin] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:00:08.301060 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-0192ac36-386a-4db3-8e8a-48d3853d8e0e admin admin] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:00:08.301476 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-0192ac36-386a-4db3-8e8a-48d3853d8e0e admin admin] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:00:08.333200 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-0192ac36-386a-4db3-8e8a-48d3853d8e0e admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.217928 Sep 23 14:00:08.333749 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 36/70] 10.222.0.62 () {60 vars in 1193 bytes} [Fri Sep 23 14:00:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 14:00:09.420492 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-d252f866-a87d-4ffd-bb70-c7000ae51448 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:00:09.421484 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-d252f866-a87d-4ffd-bb70-c7000ae51448 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Sep 23 14:00:09.421878 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 23 14:00:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:00:09.613530 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-c8f5aa16-e4fc-4080-866d-3edc6c92a7ac admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:00:09.617034 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-c8f5aa16-e4fc-4080-866d-3edc6c92a7ac admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:00:09.617506 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-c8f5aa16-e4fc-4080-866d-3edc6c92a7ac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:00:09.617928 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-c8f5aa16-e4fc-4080-866d-3edc6c92a7ac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:00:09.618667 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-c8f5aa16-e4fc-4080-866d-3edc6c92a7ac admin admin] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:00:09.619111 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-c8f5aa16-e4fc-4080-866d-3edc6c92a7ac admin admin] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:00:09.620279 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-c8f5aa16-e4fc-4080-866d-3edc6c92a7ac admin admin] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:00:09.639470 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-c8f5aa16-e4fc-4080-866d-3edc6c92a7ac admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076737 Sep 23 14:00:09.640014 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 37/72] 10.222.0.62 () {60 vars in 1193 bytes} [Fri Sep 23 14:00:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 14:00:21.163799 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-d252f866-a87d-4ffd-bb70-c7000ae51448 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:00:21.164782 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-d252f866-a87d-4ffd-bb70-c7000ae51448 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 23 14:00:21.165170 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 36/73] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 23 14:00:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:00:21.312171 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writing DB stats nova_cell0:SELECT=4 {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:21.312889 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writing DB stats nova_cell1:SELECT=4 {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:21.313504 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG dbcounter [-] [105868] Writing DB stats nova_api:SELECT=8 {{(pid=105868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:21.361223 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-8a4cee9c-cf37-4e8b-a9b3-54a3fe3201dc admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:00:21.364629 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-8a4cee9c-cf37-4e8b-a9b3-54a3fe3201dc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:00:21.365132 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-8a4cee9c-cf37-4e8b-a9b3-54a3fe3201dc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:00:21.365585 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-8a4cee9c-cf37-4e8b-a9b3-54a3fe3201dc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:00:21.366299 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-8a4cee9c-cf37-4e8b-a9b3-54a3fe3201dc admin admin] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:00:21.366760 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-8a4cee9c-cf37-4e8b-a9b3-54a3fe3201dc admin admin] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:00:21.367174 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-8a4cee9c-cf37-4e8b-a9b3-54a3fe3201dc admin admin] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:00:21.393363 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-8a4cee9c-cf37-4e8b-a9b3-54a3fe3201dc admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086206 Sep 23 14:00:21.393848 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 38/74] 10.222.0.62 () {60 vars in 1193 bytes} [Fri Sep 23 14:00:21 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:00:22.481218 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG nova.api.openstack.wsgi [None req-d252f866-a87d-4ffd-bb70-c7000ae51448 admin admin] Calling method '>' {{(pid=105867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:00:22.482209 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: INFO nova.api.openstack.requestlog [None req-d252f866-a87d-4ffd-bb70-c7000ae51448 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Sep 23 14:00:22.482635 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: [pid: 105867|app: 0|req: 37/75] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 23 14:00:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:00:22.673972 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG nova.api.openstack.wsgi [None req-541a1e0a-d4e4-48ee-8216-e6cd8b4e5017 admin admin] Calling method '>' {{(pid=105868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:00:22.677380 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-541a1e0a-d4e4-48ee-8216-e6cd8b4e5017 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:00:22.677845 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-541a1e0a-d4e4-48ee-8216-e6cd8b4e5017 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:00:22.678267 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-541a1e0a-d4e4-48ee-8216-e6cd8b4e5017 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:00:22.679017 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-541a1e0a-d4e4-48ee-8216-e6cd8b4e5017 admin admin] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:00:22.679455 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-541a1e0a-d4e4-48ee-8216-e6cd8b4e5017 admin admin] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:00:22.679864 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: DEBUG oslo_concurrency.lockutils [None req-541a1e0a-d4e4-48ee-8216-e6cd8b4e5017 admin admin] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:00:22.702151 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: INFO nova.api.openstack.requestlog [None req-541a1e0a-d4e4-48ee-8216-e6cd8b4e5017 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079515 Sep 23 14:00:22.702727 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: [pid: 105868|app: 0|req: 39/76] 10.222.0.62 () {60 vars in 1193 bytes} [Fri Sep 23 14:00:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:01:21.303863 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: Fri Sep 23 14:01:21 2022 - graceful shutdown triggered... Sep 23 14:01:21.303989 dv-cinder-857434-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 23 14:01:21.304803 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: Gracefully killing worker 1 (pid: 105867)... Sep 23 14:01:21.305177 dv-cinder-857434-4-iscsi devstack@n-api.service[105868]: Gracefully killing worker 2 (pid: 105868)... Sep 23 14:01:21.430732 dv-cinder-857434-4-iscsi devstack@n-api.service[105867]: DEBUG dbcounter [-] [105867] Writing DB stats nova_api:SELECT=4 {{(pid=105867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:22.305382 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: worker 1 buried after 1 seconds Sep 23 14:01:22.305836 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: worker 2 buried after 1 seconds Sep 23 14:01:22.305836 dv-cinder-857434-4-iscsi devstack@n-api.service[105866]: goodbye to uWSGI. Sep 23 14:01:22.306983 dv-cinder-857434-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 23 14:01:22.307542 dv-cinder-857434-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 23 14:01:22.310571 dv-cinder-857434-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 23 14:01:22.323378 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 23 14:01:22.325982 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 14:01:22 2022] *** Sep 23 14:01:22.325982 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 14:01:22.325982 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 14:01:22.325982 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: nodename: dv-cinder-857434-4-iscsi Sep 23 14:01:22.325982 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: machine: x86_64 Sep 23 14:01:22.325982 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: clock source: unix Sep 23 14:01:22.325982 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: pcre jit disabled Sep 23 14:01:22.325982 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: detected number of CPU cores: 4 Sep 23 14:01:22.325982 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: current working directory: / Sep 23 14:01:22.325982 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: detected binary path: /usr/bin/uwsgi-core Sep 23 14:01:22.326754 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: your processes number limit is 47680 Sep 23 14:01:22.326754 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: your memory page size is 4096 bytes Sep 23 14:01:22.326754 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: detected max file descriptor number: 2048 Sep 23 14:01:22.326754 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: lock engine: pthread robust mutexes Sep 23 14:01:22.326754 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: thunder lock: enabled Sep 23 14:01:22.326754 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 23 14:01:22.326754 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 14:01:22.365575 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: Python main interpreter initialized at 0x560836a4e9c0 Sep 23 14:01:22.365575 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: python threads support enabled Sep 23 14:01:22.365575 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: your server socket listen backlog is limited to 100 connections Sep 23 14:01:22.365575 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: your mercy for graceful operations on workers is 90 seconds Sep 23 14:01:22.365976 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 14:01:22.365976 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: *** Operational MODE: preforking *** Sep 23 14:01:22.366246 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: *** uWSGI is running in multiple interpreter mode *** Sep 23 14:01:22.366246 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: spawned uWSGI master process (pid: 121063) Sep 23 14:01:22.366465 dv-cinder-857434-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 23 14:01:22.373230 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: spawned uWSGI worker 1 (pid: 121073, cores: 1) Sep 23 14:01:22.373230 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: spawned uWSGI worker 2 (pid: 121074, cores: 1) Sep 23 14:01:22.373230 dv-cinder-857434-4-iscsi devstack@n-api.service[121063]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 14:01:23.028644 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 14:01:23.035685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 14:01:24.187280 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 14:01:24.187280 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: from cryptography.utils import int_from_bytes Sep 23 14:01:24.187959 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 14:01:24.187959 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: from cryptography.utils import int_from_bytes Sep 23 14:01:24.188961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 14:01:24.188961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: from cryptography.utils import int_from_bytes Sep 23 14:01:24.189426 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 14:01:24.189426 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: from cryptography.utils import int_from_bytes Sep 23 14:01:26.637308 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 14:01:26.638127 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 14:01:26.638127 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 14:01:26.638503 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 14:01:26.638712 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 14:01:26.638820 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 14:01:26.639300 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.639394 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.639749 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.640075 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.640261 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 14:01:26.640431 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.640725 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.640837 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 14:01:26.641052 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.641170 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 14:01:26.641373 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.641483 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 14:01:26.641713 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.641827 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.641981 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.642087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.642279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.642510 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.642738 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.642856 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857434-4-iscsi {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.643134 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.643284 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.643435 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.643607 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.643760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.643923 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.644083 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.644239 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.644398 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.644548 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.644701 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.644852 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.645004 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.645155 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.645312 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857434-4-iscsi {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.645464 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.647181 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.647446 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.647662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.647888 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.648119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.648341 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.648552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.648763 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.648979 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.649301 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.649536 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.649771 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.649994 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.650213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.650444 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.650737 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.650961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.651187 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.651435 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.651671 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.651902 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.652113 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857434-4-iscsi {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.652899 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.653791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.653952 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.654114 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.654277 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.654482 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.655852 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.655852 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.656143 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.656143 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.656455 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.656608 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.656753 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.656929 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.657088 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857434-4-iscsi {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.657242 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.657396 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.657540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.657694 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.657839 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.657995 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.657995 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.658311 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.658542 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.658700 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.658866 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.659026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.659170 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.659379 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.659536 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.659687 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.659843 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.659997 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.660150 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.660306 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.660458 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.660609 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.660761 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.660917 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.660917 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.661196 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.661348 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.661544 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.661703 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.661860 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.662015 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.662159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.662159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.662529 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.662529 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.662827 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.662971 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.663126 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.663279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.663432 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.663583 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.663733 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.663888 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.664032 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.664184 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.664335 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.664478 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.664642 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.664642 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.664927 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.665097 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.665741 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.665995 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.666149 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.666446 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.666738 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.666890 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.667035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.667190 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.667334 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.667477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.667639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.667791 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.667942 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.668611 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.668769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.668923 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.669085 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.669239 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.669392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.669551 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.670263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.670416 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.670514 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.670599 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.670680 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.670763 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.670834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.670928 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.671009 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.671080 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.671157 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.671238 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.671315 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.671400 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.671479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.671550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.671626 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.671696 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.671766 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.671847 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.671924 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.671995 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.672072 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.672142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.672217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.672300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.672371 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.672440 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.672508 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.672584 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.672660 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.672740 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.672811 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.672887 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.672958 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.673035 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.673121 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.673193 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.673270 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.673346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.673425 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.673502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.673581 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.673659 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.673659 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.673793 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.673864 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.673943 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.674026 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.674026 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.674160 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.674231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.674299 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.674408 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.674502 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.674574 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.674643 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.674717 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.674787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.674865 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.674942 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.675013 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.675091 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.675162 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.675231 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.675315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.675393 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.675393 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.675519 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.675588 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.675673 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.675760 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.675839 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.675909 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.676053 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.676128 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.676198 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.676267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.676343 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.676414 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.676493 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.676564 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.676633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.676711 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.676788 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.676865 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.676943 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.677020 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.677091 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.677173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.677245 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.677320 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.677390 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.677467 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.677551 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.677633 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.677704 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.677957 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.678704 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.678833 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.678952 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.679082 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.679208 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.679333 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.679448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.679558 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.679674 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.679783 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.679899 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.680008 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.680143 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.680258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.680382 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.680499 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.680608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.680723 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.680832 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.680951 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.681075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.681193 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.681303 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.681574 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.681736 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.681898 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.682041 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.682183 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.682358 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.682511 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.682674 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.682832 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.682975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.683116 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.683264 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.683405 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.683664 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.683896 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.684078 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.684231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.684383 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.684546 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 14:01:26.684697 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.685111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.685256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.685397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.685540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.685681 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.685831 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.685981 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.686164 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.686428 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.686648 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.686891 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.687135 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.687409 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.687642 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.687882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.688132 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.688373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.688633 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.688875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.689123 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.689365 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.689597 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.689874 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.690133 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.690439 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.690703 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.690970 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.691220 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.691445 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.691678 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.691903 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.692118 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.692338 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.692497 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.692642 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.692801 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.692956 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.693120 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.693264 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.693264 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.693532 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.693689 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.693840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.693995 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.694145 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.694287 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.694508 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.694669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.694822 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.694965 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.695125 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.695279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.695279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.695579 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.695729 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.695729 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.695999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.696148 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.696299 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.696449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.696449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.696726 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.696868 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.696868 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.697162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.697305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.697305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.697580 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.697723 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.697723 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.697998 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.698150 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.698150 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.698442 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.698585 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.698751 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.698903 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.698903 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.699695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.699895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.699895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.700358 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.700563 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.700710 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.700853 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.700853 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.701140 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.701299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.701460 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.701617 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.701617 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.701904 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.702046 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.702201 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.702394 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.702544 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.702686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.702838 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.702987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.703207 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.703354 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.703514 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.703664 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.703813 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.703968 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.704111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.704259 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.704402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.704544 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.704685 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.704847 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.704994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.705135 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.705283 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.705434 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.705587 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.705742 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.705885 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.706035 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.706185 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.706345 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.706495 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.706649 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.706792 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.706944 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.707087 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.707227 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.707387 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.707538 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.707682 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.707830 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.707980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.708122 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.708272 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.708421 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.708571 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.708721 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.708873 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.709022 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.709182 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.709332 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.709482 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.709631 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.709774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.709915 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.710066 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.710215 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.710375 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.710538 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.710682 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.710838 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.710981 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.711249 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.711407 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.711562 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.711713 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.711867 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.712011 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.712152 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.712301 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.712449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.712600 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.712751 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.712902 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.713052 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.713213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.713355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.713504 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.713658 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.713802 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.713944 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.714093 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.714242 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.714242 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.714566 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.714739 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.715447 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.715620 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.715773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.715930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.716083 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.716240 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.716391 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.716534 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.716676 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.716827 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.716979 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.717130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.717280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.717423 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.717586 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.717742 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.717893 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.718037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.718178 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.718365 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.718534 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.718678 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.718821 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.718971 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.719116 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.719266 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.719422 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.719575 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.719718 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.719867 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.720017 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.720159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.720309 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.720451 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.720599 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.720749 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.720892 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.721040 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.721040 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.721338 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.721497 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.721646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.721795 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.721952 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.722311 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.722508 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.722653 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.722802 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.722946 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.722946 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.723226 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.723369 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.723519 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.723680 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.723823 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.723974 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.724116 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.724265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.724409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.724551 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.724701 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.724867 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.725018 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.725167 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.725316 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.725469 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.725611 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.725769 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.725920 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.726071 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.726227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.726426 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.726587 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.726731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.726873 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.727021 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.727163 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.727304 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.727471 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.727614 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.727756 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.727896 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.728614 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.728771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.728915 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.729065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.729221 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.729372 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.729525 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.729686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.729838 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.730238 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.730447 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.730650 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.730795 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.730937 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.731079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.731229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.731383 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.731526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.731526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.731804 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.731958 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.732116 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.732116 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.732482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.732632 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.732776 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.732919 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.733075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.733225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.733547 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.733714 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.733879 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.734031 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.734194 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.734424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.734576 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.734729 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.734882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.735034 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.735186 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.735338 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.735480 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.735629 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.735779 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.735923 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.736073 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.736233 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.736376 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.736517 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.736665 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.736665 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.736961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.737106 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.737248 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.737397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.737551 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.737551 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.737829 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.737972 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.738123 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.738265 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.738428 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.738584 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.738734 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.738877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.739026 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.739177 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.739319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.739319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.739598 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.739739 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.739898 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.740041 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.740183 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.740335 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.740484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.740626 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.740775 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.740933 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.741084 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.741235 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.741385 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.741535 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.741685 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.741849 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.742005 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.742148 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.742297 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.742466 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.742619 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.742770 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.742923 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.743066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.743208 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.743364 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.743507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.743656 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.743817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.743817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.744311 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.744455 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.744618 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.744773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.744910 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.745051 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.745265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.745406 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.745547 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.745697 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.745842 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.746039 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.746141 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.746268 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.746472 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.746756 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.746900 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.747051 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.747201 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.747348 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.747499 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.747640 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.747779 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.747935 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.748083 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.748225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.748225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.748509 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.748668 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.748819 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.748967 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.749110 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.749251 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.749390 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.749521 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.749616 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.749711 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.749806 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.749899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.749992 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.750077 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.750174 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.750259 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.750359 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.750457 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.750550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.750635 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.750743 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.750891 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.750986 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.751199 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.751293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.751516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.751623 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.751821 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.751915 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.752127 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.752233 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.752434 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.752534 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.752742 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.752836 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.753049 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.753143 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.753351 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.753451 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.753654 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.753747 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.753961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.754054 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.754275 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.754387 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.754607 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.754718 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.754922 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.755033 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.755230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.755323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.755543 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.755648 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.755857 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.755949 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.756158 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.756249 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.756462 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.756562 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.756761 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.756864 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.757067 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.757159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.757384 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.757484 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.757693 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.757793 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.758011 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.758116 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.758323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.758576 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.758664 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.758799 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.758975 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.759109 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.759283 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.759387 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.759591 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.759687 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.759896 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.759987 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.760199 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.760301 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.760509 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.760600 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.760818 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.760910 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.761123 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.761216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.761438 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.761539 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.762408 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.762527 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.762684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.762777 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.763017 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.763110 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.763328 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.763435 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.763639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.763733 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.763949 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.764041 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.764263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.764372 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.764577 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.764721 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.764876 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.764996 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.765180 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.765309 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.765494 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.765613 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.765802 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.765920 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.766110 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.766230 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.766435 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.766555 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.766751 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.766870 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.767063 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.767191 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.767369 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.767494 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.767677 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.767795 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.767985 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.768098 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.768278 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.768399 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.768593 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.768868 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.769020 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.769385 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.769642 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.769956 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.770163 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.770287 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.770526 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.770634 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.770864 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.770966 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.771174 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.771280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.771485 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.771577 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.771810 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.771901 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.772133 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.772237 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.772437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.772527 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.772749 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.772866 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.773057 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.773171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.773360 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.773459 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.773663 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.773762 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.773989 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.774081 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.774319 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.774657 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.774764 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.774978 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.775113 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.775281 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.775410 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.775589 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.775690 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.775895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.775999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.776220 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.776317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.776535 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.776633 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.776843 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.776942 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.777149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.778099 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.778099 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.778281 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.778410 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.778504 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.778652 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.778817 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.778973 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.779149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.779328 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.779578 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.779689 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.779785 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.779931 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.780071 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.780176 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.780361 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.780463 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.780678 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.780771 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.780996 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.781099 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.781306 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.781406 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.781624 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.781723 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.781942 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.782036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.782257 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.782378 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.782606 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.782699 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.782912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.783036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.783236 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.783335 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.783551 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.783645 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.783864 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.783965 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.784188 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.784288 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.784512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.784612 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.784838 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.784931 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.785145 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.785244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.785456 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.785555 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.785768 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.785862 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.786078 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.786177 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.786413 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.786528 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.786727 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.786826 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.787037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.787128 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.787351 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.787463 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.787664 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.787757 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.787981 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.788074 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.788295 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.788400 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.788603 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.788696 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.788917 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.789019 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.789228 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.789383 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.789516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.789744 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.789839 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.789933 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.790145 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.790246 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.790477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.790584 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.790790 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.790883 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.791099 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.791192 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.791415 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.791513 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.791723 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.791821 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.792043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.792169 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.792357 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.792486 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.792681 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.792831 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.793025 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.793151 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.793468 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.793565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.793780 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.793880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.794099 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.794192 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.794440 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.794547 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.794752 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.794854 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.795064 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.795174 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.795386 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.795486 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.795702 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.795807 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.796095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.796187 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.796406 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.796505 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.796714 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.796816 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.797028 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.797120 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.797356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.797456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.797666 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.797761 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.797976 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.798077 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.798283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.798389 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.798633 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.798728 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.798937 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.799064 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.799309 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.799448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.799676 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.799835 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.799993 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.800096 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.800306 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.800439 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.800620 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.800726 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.800939 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.801051 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.801272 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.801382 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.801585 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.801686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.801896 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.801997 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.802207 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.802316 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.802566 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.802667 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.802874 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.802968 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.803184 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.803291 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.803515 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.803614 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.803842 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.803961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.804160 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.804315 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.804480 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.804619 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.804791 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.804947 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.805118 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.805257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.805446 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.805591 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.805754 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.805906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.806078 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.806216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.806504 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.806599 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.806824 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.806919 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.807142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.807234 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.807462 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.807552 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.807789 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.807890 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.808099 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.808193 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.808407 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.808520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.808742 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.808954 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.809151 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.809239 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.809442 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.809600 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.810003 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.810137 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.810275 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.810501 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.810609 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.810864 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.810957 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.811176 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.811276 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.811484 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.811585 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.811788 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.811888 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.812117 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.812209 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.812424 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.812523 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.812739 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.812837 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.813051 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.813149 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.813357 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.813449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.813669 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.813762 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.813980 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.814070 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.814321 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.814499 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.814642 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.814759 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.814944 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.815043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.815250 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.815352 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.815557 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.815651 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.815862 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.815963 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.816192 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.816293 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.816502 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.816596 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.816833 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.816926 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.817150 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.817256 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.817465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.817556 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.817791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.817890 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.818102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.818202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.818455 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.818555 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.818773 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.818869 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.819083 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.819201 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.819397 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.819514 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.819770 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.819887 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.819987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.820079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.820305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.820424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.820611 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.820728 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.820963 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.821068 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.821214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.821324 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.821526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.821631 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.821839 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.821941 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.822144 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.822237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.822471 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.822579 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.822800 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.822893 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.823107 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.823207 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.823433 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.823532 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.823747 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.823840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.824580 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.824682 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.824926 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.825031 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.825230 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.825323 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.825542 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.825634 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.825855 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.825949 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.826171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.826270 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.826508 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.826603 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.826818 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.826919 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.827125 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.827219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.827455 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.827556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.827769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.827870 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.828089 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.828189 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.828403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.828507 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.828715 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.828816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.829026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.829127 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.829336 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.829437 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.829659 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.829796 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.829982 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.830112 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.830321 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.830520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.830647 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.830866 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.830985 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.831192 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.831287 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.831508 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.831610 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.831825 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.831927 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.832138 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.832239 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.832452 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.832552 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.832767 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.832867 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.833079 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.833187 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.833393 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.833494 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.833705 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.833799 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.834015 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.834122 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.834372 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.834471 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.834705 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.834921 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.835018 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.835256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.835350 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.835576 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.835677 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.835893 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.836000 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.836210 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.836304 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.836530 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.836623 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.836849 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.836955 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.837166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.837259 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.837483 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.837578 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.837797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.837892 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.838111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.838211 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.838449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.838554 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.838768 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.838912 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.839084 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.839178 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.839402 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.839507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.839808 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.840663 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.840752 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.840845 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.840956 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.841117 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.841240 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.841453 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.841601 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.841756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.841923 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.842090 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.842238 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.842453 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.842587 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.842781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.842894 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.843102 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.843202 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.843420 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.843520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.843740 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.843850 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.844123 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.844264 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.844440 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.844583 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.844755 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.844920 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.845071 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.845250 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.845388 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.845578 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.845703 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.845900 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.846030 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.846220 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.846395 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.846575 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.846729 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.846895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.847053 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.847201 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.847369 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.847515 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.847690 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.847827 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.848139 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.848232 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.848466 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.848559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.848780 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.848874 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.849088 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.849184 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.849410 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.849509 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.849720 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.849814 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.850109 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.850257 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.850500 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.850786 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.850892 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.850980 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.851071 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.851266 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.851362 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.851597 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.851694 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.851923 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.852023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.852233 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.852334 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.852561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.852654 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.852872 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.852966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.853182 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.853282 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.853501 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.853601 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.853813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.854040 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.854142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.854417 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.854517 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.854742 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.854842 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.855056 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.855166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.855418 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.855518 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.855747 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.855900 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.856042 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.856379 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.856543 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.856691 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.856832 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.856981 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.857139 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.857312 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.857464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.857609 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.857751 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.857904 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.858046 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.858195 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.858360 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.858499 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.858643 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.858820 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.858967 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.859129 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.859271 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.859418 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.859564 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.859709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.859863 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.860045 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.860200 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.860352 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.860501 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.860837 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.860986 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.861138 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.861288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.861384 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.861542 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.861685 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.861840 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.861999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.862140 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.862281 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.862440 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.862582 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.862744 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.862894 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.863034 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.863182 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.863334 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.863476 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.863624 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.863790 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.863940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.864081 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.864229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.864412 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.864565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.864728 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.864874 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.865037 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.865334 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.865481 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.865665 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.865814 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.865966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.866115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.866264 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.866455 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.866609 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.866713 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.866938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.867039 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.867246 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.867352 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.867556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.867650 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.867883 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.867978 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.868196 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.868303 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.868510 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.868740 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.868834 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.869083 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.869190 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.869410 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.869562 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.869717 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.869810 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.870028 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.870172 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.870361 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.870469 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.870674 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.871496 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.871686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.871797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.871892 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.871987 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.872110 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.872206 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.872424 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.872528 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.872736 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.872828 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.873051 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.873151 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.873367 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.873506 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.873684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.873785 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.873999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.874096 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.874316 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.874447 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.874651 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.874755 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.874966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.875068 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.875281 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.875532 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.875633 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.875853 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.875952 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.876167 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.876261 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.876490 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.876588 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.876827 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.876921 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.877146 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.877246 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.877455 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.877560 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.877780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.877881 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.878103 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.878203 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.878445 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.878542 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.878764 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.878867 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.879081 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.879174 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.879398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.879489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.879722 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.879827 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.880050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.880142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.880369 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.880463 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.880679 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.880815 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.881073 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.881192 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.881335 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.881464 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.881668 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.881773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.881995 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.882088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.882304 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.882445 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.882639 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.882745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.882946 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.883047 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.883256 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.883358 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.883574 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.883675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.883884 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.883985 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.884189 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.884290 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.884494 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.884594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.884803 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.884897 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.885106 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.885213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.885409 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.885502 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.885714 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.885807 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.886019 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.886127 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.886347 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.886456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.887254 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.887415 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.887562 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.887709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.887867 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.887970 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.888172 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.888264 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.888477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.888579 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.888782 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.888882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.889088 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.889181 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.889390 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.889483 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.889695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.889794 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.889994 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.890099 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.890296 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.890427 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.890622 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.890726 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.890929 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.891230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.891337 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.891432 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.891517 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.891609 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.891823 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.891928 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.892135 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.892229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.892441 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.892533 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.892751 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.892866 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.893060 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.893155 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.893366 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.893477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.893671 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.893778 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.894005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.894103 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.894352 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.894461 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.894673 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.894767 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.894988 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.895080 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.895302 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.895401 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.895610 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.895703 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.895921 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.896014 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.896232 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.896327 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.896557 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.896649 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.896874 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.896975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.897180 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.897271 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.897505 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.897606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.897817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.897916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.898131 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.898233 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.898469 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.898576 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.898781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.898881 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.899093 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.899194 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.899409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.899508 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.899717 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.899809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.900026 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.900132 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.900337 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.900473 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.900649 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.900751 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.900965 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.901104 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.901325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.901432 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.901588 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.901682 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.901901 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.901994 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.902247 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.902442 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.902617 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.902780 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.902888 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.903033 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.903195 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.903347 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.903512 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.903678 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.903821 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.904007 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.904133 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.904353 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.904446 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.904667 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.904761 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.905010 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.905109 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.905340 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.905434 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.905659 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.905760 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.905976 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.906068 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.906284 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.906415 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.906566 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 14:01:26.906660 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.906954 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.907305 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.907622 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.907969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.908301 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.908623 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.908942 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.909255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 14:01:26.909503 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 14:01:26.968995 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO dbcounter [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] Registered counter for database nova_api Sep 23 14:01:26.971607 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO dbcounter [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] Registered counter for database nova_api Sep 23 14:01:26.989415 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_db.sqlalchemy.engines [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 14:01:26.991136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_db.sqlalchemy.engines [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 14:01:26.996867 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writer thread running {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 14:01:26.998418 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writer thread running {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 14:01:27.052140 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.context [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9b62a15-663d-4061-af73-b76bf6ffc81b(cell1) {{(pid=121073) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 14:01:27.054182 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.context [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9b62a15-663d-4061-af73-b76bf6ffc81b(cell1) {{(pid=121074) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 14:01:27.056150 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:01:27.056628 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:01:27.058181 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:01:27.058285 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:01:27.059261 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:01:27.060010 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:01:27.060285 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:01:27.061098 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:01:27.061830 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:01:27.062276 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:01:27.062405 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:01:27.064289 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO dbcounter [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] Registered counter for database nova_cell0 Sep 23 14:01:27.064421 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:01:27.066301 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO dbcounter [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] Registered counter for database nova_cell0 Sep 23 14:01:27.068628 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO dbcounter [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] Registered counter for database nova_cell1 Sep 23 14:01:27.070356 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO dbcounter [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] Registered counter for database nova_cell1 Sep 23 14:01:27.077283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_db.sqlalchemy.engines [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 14:01:27.079235 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_db.sqlalchemy.engines [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 14:01:27.081324 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_db.sqlalchemy.engines [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 14:01:27.083569 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_db.sqlalchemy.engines [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 14:01:27.086437 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writer thread running {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 14:01:27.087066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writer thread running {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 14:01:27.089031 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writer thread running {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 14:01:27.093522 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writer thread running {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 14:01:27.237078 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO dbcounter [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] Registered counter for database nova_cell0 Sep 23 14:01:27.244058 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_db.sqlalchemy.engines [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 14:01:27.248606 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO dbcounter [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] Registered counter for database nova_cell0 Sep 23 14:01:27.248767 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writer thread running {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 14:01:27.256183 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_db.sqlalchemy.engines [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 14:01:27.261322 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writer thread running {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 14:01:27.571206 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: WARNING keystonemiddleware.auth_token [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 14:01:27.578834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: WARNING keystonemiddleware.auth_token [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 14:01:27.588559 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: WARNING keystonemiddleware.auth_token [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 14:01:27.596296 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: WARNING keystonemiddleware.auth_token [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 14:01:27.930115 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: WARNING keystonemiddleware.auth_token [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 14:01:27.937126 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: WARNING keystonemiddleware.auth_token [None req-14f34713-61e9-4d1a-9cb1-52d192bc50de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 14:01:27.942507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560836a4e9c0 pid: 121074 (default app) Sep 23 14:01:27.944280 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: WARNING keystonemiddleware.auth_token [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 14:01:27.950769 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: WARNING keystonemiddleware.auth_token [None req-aecb1695-5c65-4caa-982d-899060d013ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 14:01:27.956120 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560836a4e9c0 pid: 121073 (default app) Sep 23 14:02:06.102845 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=3 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:06.103900 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=3 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:06.104862 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=3 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:06.106306 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=3 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:07.776756 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6bb7c1d6-50f7-4728-9e90-0f985a4dfcfb tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Action: 'create', calling method: .version_select at 0x7f9088b6d4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1009310777", "metadata": {"Type": "work"}}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6bb7c1d6-50f7-4728-9e90-0f985a4dfcfb tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Request method failure captured: Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 122 Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxe1E51v-cLo2J359aMYw4Dy39ss_jJZmMP31jMnNQqPVswF-bL4ctldXuRMjbs7ujr7WghoHeqe52cSnMxib-nNB4zIhoD8Mo3ONUfnqhlF1SDXRqGF0tA9QvSVDn4KUKdBeV7kWpuc6-ibANm9LblXHPZjQXXhW5VjcD6N7kNPIg Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 23b284ca6c134f958ca475088e669dec Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:02:07.786216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:02:07.787663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/23b284ca6c134f958ca475088e669dec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/23b284ca6c134f958ca475088e669dec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/23b284ca6c134f958ca475088e669dec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_23b284ca6c134f958ca475088e669dec"}]}] Sep 23 14:02:07.787663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:07.787663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 23b284ca6c134f958ca475088e669dec Sep 23 14:02:07.787663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:07.787663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-VolumesNegativeTest-744368284-project Sep 23 14:02:07.787663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:02:07.787663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:02:07.787663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 58f69d8a60a14a2ea87fd840e8b0c916 Sep 23 14:02:07.787663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-VolumesNegativeTest-744368284-project Sep 23 14:02:07.787663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Sep 23 14:02:07.787663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1009310777", "metadata": {"Type": "work"}}} Sep 23 14:02:07.787663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: Sep 23 14:02:07.787663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1009310777', 'metadata': {'Type': 'work'}}}} Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise error Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi '#$%' Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:02:07.790111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 14:02:07.791879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 14:02:07.794188 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 14:02:07.794188 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:07.794188 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6bb7c1d6-50f7-4728-9e90-0f985a4dfcfb tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:02:07.794188 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6bb7c1d6-50f7-4728-9e90-0f985a4dfcfb tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.693365 Sep 23 14:02:07.794188 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1156 bytes} [Fri Sep 23 14:02:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1695 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 14:02:08.318740 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a22a3e6e-30d8-4692-ab86-0092620195c7 tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Action: 'create', calling method: .version_select at 0x7f9088c194c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1482419631", "metadata": {"Type": "work"}}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a22a3e6e-30d8-4692-ab86-0092620195c7 tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Request method failure captured: Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 120 Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbxe1E51v-cLo2J359aMYw4Dy39ss_jJZmMP31jMnNQqPVswF-bL4ctldXuRMjbs7ujr7WghoHeqe52cSnMxib-nNB4zIhoD8Mo3ONUfnqhlF1SDXRqGF0tA9QvSVDn4KUKdBeV7kWpuc6-ibANm9LblXHPZjQXXhW5VjcD6N7kNPIg Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 23b284ca6c134f958ca475088e669dec Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:02:08.327165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:02:08.332465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/23b284ca6c134f958ca475088e669dec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/23b284ca6c134f958ca475088e669dec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/23b284ca6c134f958ca475088e669dec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_23b284ca6c134f958ca475088e669dec"}]}] Sep 23 14:02:08.332465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:08.332465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 23b284ca6c134f958ca475088e669dec Sep 23 14:02:08.332465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:08.332465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-VolumesNegativeTest-744368284-project Sep 23 14:02:08.332465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:02:08.332465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:02:08.332465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 58f69d8a60a14a2ea87fd840e8b0c916 Sep 23 14:02:08.332465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-VolumesNegativeTest-744368284-project Sep 23 14:02:08.332465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Sep 23 14:02:08.332465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1482419631", "metadata": {"Type": "work"}}} Sep 23 14:02:08.332465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: Sep 23 14:02:08.332465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1482419631', 'metadata': {'Type': 'work'}}}} Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise error Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi '0' Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:02:08.333185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 14:02:08.334100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 14:02:08.338089 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 14:02:08.338089 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:08.338089 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a22a3e6e-30d8-4692-ab86-0092620195c7 tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:02:08.338089 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a22a3e6e-30d8-4692-ab86-0092620195c7 tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.537263 Sep 23 14:02:08.338089 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 1/2] 10.222.0.62 () {60 vars in 1156 bytes} [Fri Sep 23 14:02:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 539 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 14:02:08.344382 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fd535b20-e9c5-43c6-bece-ad1361f3571f tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Action: 'create', calling method: .version_select at 0x7f9088b6ddc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-981882739", "metadata": {"Type": "work"}}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fd535b20-e9c5-43c6-bece-ad1361f3571f tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Request method failure captured: Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 118 Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxe1E51v-cLo2J359aMYw4Dy39ss_jJZmMP31jMnNQqPVswF-bL4ctldXuRMjbs7ujr7WghoHeqe52cSnMxib-nNB4zIhoD8Mo3ONUfnqhlF1SDXRqGF0tA9QvSVDn4KUKdBeV7kWpuc6-ibANm9LblXHPZjQXXhW5VjcD6N7kNPIg Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 23b284ca6c134f958ca475088e669dec Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:02:08.348594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:02:08.349639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/23b284ca6c134f958ca475088e669dec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/23b284ca6c134f958ca475088e669dec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/23b284ca6c134f958ca475088e669dec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_23b284ca6c134f958ca475088e669dec"}]}] Sep 23 14:02:08.349639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:08.349639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 23b284ca6c134f958ca475088e669dec Sep 23 14:02:08.349639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:08.349639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-VolumesNegativeTest-744368284-project Sep 23 14:02:08.349639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:02:08.349639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:02:08.349639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 58f69d8a60a14a2ea87fd840e8b0c916 Sep 23 14:02:08.349639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-VolumesNegativeTest-744368284-project Sep 23 14:02:08.349639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Sep 23 14:02:08.349639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-981882739", "metadata": {"Type": "work"}}} Sep 23 14:02:08.349639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: Sep 23 14:02:08.349639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-981882739', 'metadata': {'Type': 'work'}}}} Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise error Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi '' Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:02:08.350274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 14:02:08.351456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 14:02:08.352244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 14:02:08.352244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:08.353224 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fd535b20-e9c5-43c6-bece-ad1361f3571f tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:02:08.354273 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fd535b20-e9c5-43c6-bece-ad1361f3571f tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017093 Sep 23 14:02:08.356525 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 2/3] 10.222.0.62 () {60 vars in 1156 bytes} [Fri Sep 23 14:02:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 14:02:08.365445 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=3 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:08.366591 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=3 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:08.368062 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=3 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:08.369124 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=3 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:08.380464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-84e694af-f393-4fa0-a248-854c94017b8d tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Calling method '.version_select at 0x7f9088bc19d0>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:09.292501 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-84e694af-f393-4fa0-a248-854c94017b8d tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] HTTP exception thrown: Volume tempest-invalid-678901235 could not be found. Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-84e694af-f393-4fa0-a248-854c94017b8d tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Request method failure captured: Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-678901235 HTTP/1.1 Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbxe1E51v-cLo2J359aMYw4Dy39ss_jJZmMP31jMnNQqPVswF-bL4ctldXuRMjbs7ujr7WghoHeqe52cSnMxib-nNB4zIhoD8Mo3ONUfnqhlF1SDXRqGF0tA9QvSVDn4KUKdBeV7kWpuc6-ibANm9LblXHPZjQXXhW5VjcD6N7kNPIg Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 23b284ca6c134f958ca475088e669dec Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:02:09.307202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:02:09.312265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/23b284ca6c134f958ca475088e669dec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/23b284ca6c134f958ca475088e669dec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/23b284ca6c134f958ca475088e669dec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_23b284ca6c134f958ca475088e669dec"}]}] Sep 23 14:02:09.312265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:09.312265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 23b284ca6c134f958ca475088e669dec Sep 23 14:02:09.312265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:09.312265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-VolumesNegativeTest-744368284-project Sep 23 14:02:09.312265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:02:09.312265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:02:09.312265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 58f69d8a60a14a2ea87fd840e8b0c916 Sep 23 14:02:09.312265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-VolumesNegativeTest-744368284-project Sep 23 14:02:09.312265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: Sep 23 14:02:09.312265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Volume tempest-invalid-678901235 could not be found. Sep 23 14:02:09.312265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': 'tempest-invalid-678901235'} Sep 23 14:02:09.312265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-678901235 could not be found. (HTTP 404) (Request-ID: req-ab798604-7fba-4c56-a170-760296e4a2b3) Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:09.312930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 14:02:09.313882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-678901235 could not be found. Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:02:09.314782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-678901235 could not be found. Sep 23 14:02:09.315652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.315652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:09.315652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.315652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:09.315652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:02:09.315652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:02:09.315652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:02:09.315652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:02:09.315652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-678901235 could not be found. Sep 23 14:02:09.315652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.315652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-84e694af-f393-4fa0-a248-854c94017b8d tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Returning 404 to user: Volume tempest-invalid-678901235 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:02:09.315652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-84e694af-f393-4fa0-a248-854c94017b8d tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-678901235" status: 404 len: 98 microversion: 2.1 time: 0.950056 Sep 23 14:02:09.316648 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1215 bytes} [Fri Sep 23 14:02:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-678901235 => generated 98 bytes in 953 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 14:02:09.328318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-378c285e-5168-44f5-b8e2-ac5c68a53798 tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004262 Sep 23 14:02:09.335602 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 3/5] 10.222.0.62 () {58 vars in 1140 bytes} [Fri Sep 23 14:02:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 14:02:09.358362 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-847566ad-dbdb-49a9-a33e-138d8cb431b0 tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006852 Sep 23 14:02:09.363671 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 3/6] 10.222.0.62 () {58 vars in 1137 bytes} [Fri Sep 23 14:02:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 14:02:09.376124 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-52a01f21-2562-46b7-aa13-20ec2141b01f tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Calling method '.version_select at 0x7f9088a28430>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:09.857474 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-52a01f21-2562-46b7-aa13-20ec2141b01f tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] HTTP exception thrown: Volume 498eb962-9dea-4e8f-aa58-9d1611bca1f4 could not be found. Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-52a01f21-2562-46b7-aa13-20ec2141b01f tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Request method failure captured: Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: DELETE /compute/v2.1/os-volumes/498eb962-9dea-4e8f-aa58-9d1611bca1f4 HTTP/1.1 Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxe1E51v-cLo2J359aMYw4Dy39ss_jJZmMP31jMnNQqPVswF-bL4ctldXuRMjbs7ujr7WghoHeqe52cSnMxib-nNB4zIhoD8Mo3ONUfnqhlF1SDXRqGF0tA9QvSVDn4KUKdBeV7kWpuc6-ibANm9LblXHPZjQXXhW5VjcD6N7kNPIg Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 23b284ca6c134f958ca475088e669dec Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:02:09.861859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:02:09.863069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/23b284ca6c134f958ca475088e669dec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/23b284ca6c134f958ca475088e669dec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/23b284ca6c134f958ca475088e669dec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_23b284ca6c134f958ca475088e669dec"}]}] Sep 23 14:02:09.863069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:09.863069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 23b284ca6c134f958ca475088e669dec Sep 23 14:02:09.863069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:09.863069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-VolumesNegativeTest-744368284-project Sep 23 14:02:09.863069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:02:09.863069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:02:09.863069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 58f69d8a60a14a2ea87fd840e8b0c916 Sep 23 14:02:09.863069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-VolumesNegativeTest-744368284-project Sep 23 14:02:09.863069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: Sep 23 14:02:09.863069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Volume 498eb962-9dea-4e8f-aa58-9d1611bca1f4 could not be found. Sep 23 14:02:09.863069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': '498eb962-9dea-4e8f-aa58-9d1611bca1f4'} Sep 23 14:02:09.863069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 498eb962-9dea-4e8f-aa58-9d1611bca1f4 could not be found. (HTTP 404) (Request-ID: req-f8599040-cfb9-4d15-9811-abdcffac1b4c) Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:09.863847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 14:02:09.864773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 498eb962-9dea-4e8f-aa58-9d1611bca1f4 could not be found. Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 14:02:09.867880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:02:09.870288 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 498eb962-9dea-4e8f-aa58-9d1611bca1f4 could not be found. Sep 23 14:02:09.870288 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.870288 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:09.870288 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.870288 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:09.870288 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:02:09.870288 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:02:09.870288 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:02:09.870288 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:02:09.870288 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 498eb962-9dea-4e8f-aa58-9d1611bca1f4 could not be found. Sep 23 14:02:09.870288 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.872984 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-52a01f21-2562-46b7-aa13-20ec2141b01f tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Returning 404 to user: Volume 498eb962-9dea-4e8f-aa58-9d1611bca1f4 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:02:09.874390 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-52a01f21-2562-46b7-aa13-20ec2141b01f tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/498eb962-9dea-4e8f-aa58-9d1611bca1f4" status: 404 len: 109 microversion: 2.1 time: 0.503306 Sep 23 14:02:09.883822 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 23 14:02:09 2022] DELETE /compute/v2.1/os-volumes/498eb962-9dea-4e8f-aa58-9d1611bca1f4 => generated 109 bytes in 505 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:02:09.888574 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c86a9bda-c475-4d49-8661-c300dc71e02e tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Calling method '.version_select at 0x7f90889520d0>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:09.932822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-c86a9bda-c475-4d49-8661-c300dc71e02e tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] HTTP exception thrown: Volume e43e83dd-d86a-4b20-b6ef-a73baff7e4c1 could not be found. Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c86a9bda-c475-4d49-8661-c300dc71e02e tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Request method failure captured: Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/os-volumes/e43e83dd-d86a-4b20-b6ef-a73baff7e4c1 HTTP/1.1 Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbxe1E51v-cLo2J359aMYw4Dy39ss_jJZmMP31jMnNQqPVswF-bL4ctldXuRMjbs7ujr7WghoHeqe52cSnMxib-nNB4zIhoD8Mo3ONUfnqhlF1SDXRqGF0tA9QvSVDn4KUKdBeV7kWpuc6-ibANm9LblXHPZjQXXhW5VjcD6N7kNPIg Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 23b284ca6c134f958ca475088e669dec Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:02:09.935924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:02:09.936964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/23b284ca6c134f958ca475088e669dec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/23b284ca6c134f958ca475088e669dec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/23b284ca6c134f958ca475088e669dec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_23b284ca6c134f958ca475088e669dec"}]}] Sep 23 14:02:09.936964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:09.936964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 23b284ca6c134f958ca475088e669dec Sep 23 14:02:09.936964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-VolumesNegativeTest-744368284 Sep 23 14:02:09.936964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-VolumesNegativeTest-744368284-project Sep 23 14:02:09.936964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:02:09.936964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:02:09.936964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 58f69d8a60a14a2ea87fd840e8b0c916 Sep 23 14:02:09.936964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-VolumesNegativeTest-744368284-project Sep 23 14:02:09.936964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: Sep 23 14:02:09.936964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Volume e43e83dd-d86a-4b20-b6ef-a73baff7e4c1 could not be found. Sep 23 14:02:09.936964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': 'e43e83dd-d86a-4b20-b6ef-a73baff7e4c1'} Sep 23 14:02:09.936964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e43e83dd-d86a-4b20-b6ef-a73baff7e4c1 could not be found. (HTTP 404) (Request-ID: req-af6ae786-8115-4c99-adb9-cedf0afc765c) Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:09.937565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 14:02:09.938449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e43e83dd-d86a-4b20-b6ef-a73baff7e4c1 could not be found. Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 14:02:09.939299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:02:09.940111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e43e83dd-d86a-4b20-b6ef-a73baff7e4c1 could not be found. Sep 23 14:02:09.940111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.940111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:02:09.940111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.940111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:02:09.940111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:02:09.940111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:02:09.940111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:02:09.940111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:02:09.940111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e43e83dd-d86a-4b20-b6ef-a73baff7e4c1 could not be found. Sep 23 14:02:09.940111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:02:09.943496 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c86a9bda-c475-4d49-8661-c300dc71e02e tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] Returning 404 to user: Volume e43e83dd-d86a-4b20-b6ef-a73baff7e4c1 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:02:09.946344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c86a9bda-c475-4d49-8661-c300dc71e02e tempest-VolumesNegativeTest-744368284 tempest-VolumesNegativeTest-744368284-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/e43e83dd-d86a-4b20-b6ef-a73baff7e4c1" status: 404 len: 109 microversion: 2.1 time: 0.063884 Sep 23 14:02:09.947619 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 23 14:02:09 2022] GET /compute/v2.1/os-volumes/e43e83dd-d86a-4b20-b6ef-a73baff7e4c1 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:02:10.392435 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ee9fd00b-2469-45b4-bcdc-44c0d3a7b898 tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] Calling method '.version_select at 0x7f90889aff70>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:10.466424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ee9fd00b-2469-45b4-bcdc-44c0d3a7b898 tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bb9e9f2e-4d15-4ab4-98aa-ec15f8ca6160" status: 200 len: 350 microversion: 2.1 time: 0.078574 Sep 23 14:02:10.467228 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 5/9] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 23 14:02:10 2022] GET /compute/v2.1/os-volumes/bb9e9f2e-4d15-4ab4-98aa-ec15f8ca6160 => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:02:12.470548 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-7b263991-6638-441d-89c1-13bde2187eac tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] Calling method '.version_select at 0x7f90889a8dc0>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:12.581980 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-7b263991-6638-441d-89c1-13bde2187eac tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/c3f45085-0337-49f8-8a9e-a4b95976e046" status: 200 len: 350 microversion: 2.1 time: 0.116189 Sep 23 14:02:12.582884 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 5/10] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 23 14:02:12 2022] GET /compute/v2.1/os-volumes/c3f45085-0337-49f8-8a9e-a4b95976e046 => generated 350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:02:15.975159 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1779097854", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:16.238095 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.network.neutron [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] validate_networks() for [('35b1eec9-f37f-4a15-9846-f6e35c1c3a12', None, None, None, None, None)] {{(pid=121074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:02:16.992829 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-72f7e092-24d8-48d6-b7be-1e2d84428030 tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] Calling method '.version_select at 0x7f9088952820>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:17.119450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-72f7e092-24d8-48d6-b7be-1e2d84428030 tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/181be5da-20c1-40b7-adf1-17ca19557e16" status: 200 len: 351 microversion: 2.1 time: 0.126497 Sep 23 14:02:17.121432 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 6/11] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 23 14:02:16 2022] GET /compute/v2.1/os-volumes/181be5da-20c1-40b7-adf1-17ca19557e16 => generated 351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:02:17.137982 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6183fcba-a8ea-4600-8ad2-1b92e885d76d tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] Calling method '.version_select at 0x7f9088952040>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:17.536036 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-6183fcba-a8ea-4600-8ad2-1b92e885d76d tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.404766 Sep 23 14:02:17.536955 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 7/12] 10.222.0.62 () {58 vars in 1134 bytes} [Fri Sep 23 14:02:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:02:17.554620 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-2b6ba379-7c54-461a-a7e5-469030cdadd9 tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] Calling method '.version_select at 0x7f9088952160>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:17.799290 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-2b6ba379-7c54-461a-a7e5-469030cdadd9 tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.250813 Sep 23 14:02:17.800604 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 8/13] 10.222.0.62 () {58 vars in 1149 bytes} [Fri Sep 23 14:02:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:02:17.820936 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-2555bec8-64e6-493e-8541-9b9e21d92ce5 tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] Calling method '.version_select at 0x7f90889a8d30>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:18.067076 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-2555bec8-64e6-493e-8541-9b9e21d92ce5 tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.254750 Sep 23 14:02:18.067808 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 9/14] 10.222.0.62 () {58 vars in 1134 bytes} [Fri Sep 23 14:02:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:18.084552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b7f72e6c-dd6a-45ef-809d-970dd27bbcdc tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] Calling method '.version_select at 0x7f908895a0d0>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:18.318520 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b7f72e6c-dd6a-45ef-809d-970dd27bbcdc tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.240444 Sep 23 14:02:18.319937 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 10/15] 10.222.0.62 () {58 vars in 1167 bytes} [Fri Sep 23 14:02:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:02:18.333623 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-92bd2bec-d57a-4120-ac8d-77f800c4af73 tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] Calling method '.version_select at 0x7f9088bc1700>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:18.530603 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-92bd2bec-d57a-4120-ac8d-77f800c4af73 tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.200596 Sep 23 14:02:18.539933 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 11/16] 10.222.0.62 () {58 vars in 1170 bytes} [Fri Sep 23 14:02:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:02:18.545114 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-7eb76439-a59f-48b7-865a-9ec41d04b683 tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] Calling method '.version_select at 0x7f9088952820>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:18.765964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-7eb76439-a59f-48b7-865a-9ec41d04b683 tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.224594 Sep 23 14:02:18.766762 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 12/17] 10.222.0.62 () {58 vars in 1155 bytes} [Fri Sep 23 14:02:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:02:18.781725 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a4f964d4-a792-4134-b347-a718304e7895 tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] Calling method '.version_select at 0x7f90889600d0>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:19.023711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a4f964d4-a792-4134-b347-a718304e7895 tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.244741 Sep 23 14:02:19.023711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 13/18] 10.222.0.62 () {58 vars in 1188 bytes} [Fri Sep 23 14:02:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:02:19.036032 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-428ffe39-18c8-4afe-b9da-76d182f1e7bc tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] Calling method '.version_select at 0x7f9088952790>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:19.040795 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Flavor limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:02:19.042617 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Image limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:02:19.043274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Flavor pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:02:19.043840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Image pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:02:19.044413 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:02:19.121229 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:19.123527 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:19.143216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:19.145078 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:19.148580 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:19.150785 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:19.249637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-428ffe39-18c8-4afe-b9da-76d182f1e7bc tempest-VolumesTestJSON-726440733 tempest-VolumesTestJSON-726440733-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.216826 Sep 23 14:02:19.249637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 14/19] 10.222.0.62 () {58 vars in 1155 bytes} [Fri Sep 23 14:02:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:02:19.261901 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Getting quotas for project d08a219027684089a91c354749c67d5d. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:02:19.272768 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Getting quotas for user 28b64a35d7b44519a1d93919f2e23083 and project d08a219027684089a91c354749c67d5d. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:02:19.311525 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Going to run 1 instances... {{(pid=121074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:02:19.322997 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:02:19.598689 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e1aa7dc9-0951-45c0-8d21-9a8460d6f4b5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.843049 Sep 23 14:02:19.609826 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 6/20] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:02:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 14:02:19.624546 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b7b8915c-8154-41a2-af64-4b799bfad4b0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:19.625205 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b7b8915c-8154-41a2-af64-4b799bfad4b0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:19.946885 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b7b8915c-8154-41a2-af64-4b799bfad4b0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:19.971210 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b7b8915c-8154-41a2-af64-4b799bfad4b0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1222 microversion: 2.1 time: 0.352293 Sep 23 14:02:19.972895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 15/21] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:19 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1222 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:20.559249 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1578389408", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:20.791926 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.network.neutron [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] validate_networks() for [('35b1eec9-f37f-4a15-9846-f6e35c1c3a12', None, None, None, None, None)] {{(pid=121073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:02:21.178022 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fbc8114c-ddf4-424c-a886-95321aa6a5d0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Action: 'create', calling method: .version_select at 0x7f908806b550>, body: {"keypair": {"name": "tempest-keypair-1625848752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzQHItvu/x6qWw1ftxCBZrxpzcSwYacNd1cAcJP0xDteTDKdxfwVC0XGa04tUbXcb/VOKpcRIp6CTdadIVSB6EcSTaNCFCyv0HBAWTCUe1Hjijk1kA6YGNXKAjxmJimAg=="}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:21.222547 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-fbc8114c-ddf4-424c-a886-95321aa6a5d0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for project 482490c45ac64607bba9ad021f2effbf. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:02:21.243641 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-fbc8114c-ddf4-424c-a886-95321aa6a5d0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for user 0db30f990aae49fabf9b8b19cd019de9 and project 482490c45ac64607bba9ad021f2effbf. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:02:21.384805 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fbc8114c-ddf4-424c-a886-95321aa6a5d0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.198148 Sep 23 14:02:21.385583 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 7/22] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 23 14:02:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:02:21.808529 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-719506617", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "networks": [{"uuid": "dd74ac86-6ee7-4508-a7d9-4e3088c0fc4a"}]}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:21.902997 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.network.neutron [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] validate_networks() for [('dd74ac86-6ee7-4508-a7d9-4e3088c0fc4a', None, None, None, None, None)] {{(pid=121074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:02:22.797264 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Flavor limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:02:22.797806 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Image limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:02:22.798860 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Flavor pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:02:22.799430 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Image pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:02:22.807952 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:02:22.853278 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:22.855976 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:22.862988 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:22.864128 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:22.865024 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:22.883230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:23.077574 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Flavor limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:02:23.078133 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Image limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:02:23.078687 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Flavor pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:02:23.079106 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Image pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:02:23.079521 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:02:23.101058 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:23.107356 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:23.110061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:23.113321 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:23.113852 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:23.114297 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:23.169745 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Getting quotas for project d08a219027684089a91c354749c67d5d. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:02:23.183348 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Getting quotas for user 28b64a35d7b44519a1d93919f2e23083 and project d08a219027684089a91c354749c67d5d. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:02:23.224132 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Getting quotas for project 8e1a67a82fb44cf59f9b4f30848881d1. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:02:23.237880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Getting quotas for user 88a8db8d7d494c62b65e427278ef9a2a and project 8e1a67a82fb44cf59f9b4f30848881d1. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:02:23.257989 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Going to run 1 instances... {{(pid=121073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:02:23.260543 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:02:23.288939 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Going to run 1 instances... {{(pid=121074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:02:23.291164 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:02:23.521392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-3d6fa780-2be1-43e0-9119-1a6b0ca3cbb8 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.134266 Sep 23 14:02:23.526370 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 8/23] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:02:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 14:02:23.540392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f0ec3c8f-62c7-4ade-9a9b-662e1e9dc4e4 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:23.542963 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f0ec3c8f-62c7-4ade-9a9b-662e1e9dc4e4 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:23.609465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ab94cad3-c01b-4886-8364-699f872588c5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.055254 Sep 23 14:02:23.611013 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 16/24] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:02:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 3058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 14:02:23.626689 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c75637e8-c06f-4ca9-94e5-25f024d5040c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:23.629097 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c75637e8-c06f-4ca9-94e5-25f024d5040c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:24.099440 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f0ec3c8f-62c7-4ade-9a9b-662e1e9dc4e4 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:24.124640 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f0ec3c8f-62c7-4ade-9a9b-662e1e9dc4e4 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1214 microversion: 2.1 time: 0.588922 Sep 23 14:02:24.124640 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 9/25] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:23 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1214 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:24.142779 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c75637e8-c06f-4ca9-94e5-25f024d5040c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:24.158406 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c75637e8-c06f-4ca9-94e5-25f024d5040c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1222 microversion: 2.1 time: 0.531548 Sep 23 14:02:24.159123 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 17/26] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:23 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1222 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:25.152755 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b380eda3-f2fe-48b8-8eea-0b5c93bbc063 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:25.153365 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b380eda3-f2fe-48b8-8eea-0b5c93bbc063 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:25.190093 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ace641e7-7b5f-4d81-bf19-9c6ef60d82cd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:25.199807 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ace641e7-7b5f-4d81-bf19-9c6ef60d82cd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:25.299909 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b380eda3-f2fe-48b8-8eea-0b5c93bbc063 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:25.309054 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b380eda3-f2fe-48b8-8eea-0b5c93bbc063 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1214 microversion: 2.1 time: 0.160347 Sep 23 14:02:25.309627 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 10/27] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:25 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:25.355997 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ace641e7-7b5f-4d81-bf19-9c6ef60d82cd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:25.364299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ace641e7-7b5f-4d81-bf19-9c6ef60d82cd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1222 microversion: 2.1 time: 0.181541 Sep 23 14:02:25.369868 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 18/28] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:25 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1222 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:26.338680 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9d449aef-46bd-4ea0-9aeb-e8f9ca787af4 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:26.339415 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-9d449aef-46bd-4ea0-9aeb-e8f9ca787af4 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:26.352577 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-720151486", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34e7a0c6-e35b-482b-a11c-b3c893e03a50"}], "security_groups": [{"name": "tempest-securitygroup--1969742839"}], "key_name": "tempest-keypair-1625848752", "user_data": "}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:26.356057 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9d449aef-46bd-4ea0-9aeb-e8f9ca787af4 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:26.356571 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9d449aef-46bd-4ea0-9aeb-e8f9ca787af4 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:26.357031 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9d449aef-46bd-4ea0-9aeb-e8f9ca787af4 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:26.357787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9d449aef-46bd-4ea0-9aeb-e8f9ca787af4 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:26.358308 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9d449aef-46bd-4ea0-9aeb-e8f9ca787af4 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:26.373893 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9d449aef-46bd-4ea0-9aeb-e8f9ca787af4 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:27.434717 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.network.neutron [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] validate_networks() for [('34e7a0c6-e35b-482b-a11c-b3c893e03a50', None, None, None, None, None)] {{(pid=121073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:02:27.536101 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9d449aef-46bd-4ea0-9aeb-e8f9ca787af4 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:27.578676 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-9d449aef-46bd-4ea0-9aeb-e8f9ca787af4 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1218 microversion: 2.1 time: 1.244308 Sep 23 14:02:27.579278 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 11/29] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:26 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1218 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:27.587612 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-24b2c94b-5437-46c6-bcb9-00598a30cbc0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:27.588886 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-24b2c94b-5437-46c6-bcb9-00598a30cbc0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:27.602612 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-24b2c94b-5437-46c6-bcb9-00598a30cbc0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:27.603343 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-24b2c94b-5437-46c6-bcb9-00598a30cbc0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:27.605967 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-24b2c94b-5437-46c6-bcb9-00598a30cbc0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:27.608936 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-24b2c94b-5437-46c6-bcb9-00598a30cbc0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:27.609603 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-24b2c94b-5437-46c6-bcb9-00598a30cbc0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:27.612573 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-24b2c94b-5437-46c6-bcb9-00598a30cbc0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:28.157573 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-24b2c94b-5437-46c6-bcb9-00598a30cbc0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:28.169317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-24b2c94b-5437-46c6-bcb9-00598a30cbc0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1274 microversion: 2.1 time: 0.588983 Sep 23 14:02:28.169905 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 12/30] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:27 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1274 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:28.602702 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-41e7b93f-af3a-4726-9842-81ade618f71b tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:28.604243 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-41e7b93f-af3a-4726-9842-81ade618f71b tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:28.623366 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-41e7b93f-af3a-4726-9842-81ade618f71b tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:28.624199 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-41e7b93f-af3a-4726-9842-81ade618f71b tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:28.624985 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-41e7b93f-af3a-4726-9842-81ade618f71b tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:28.625965 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-41e7b93f-af3a-4726-9842-81ade618f71b tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:28.628738 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-41e7b93f-af3a-4726-9842-81ade618f71b tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:28.630243 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-41e7b93f-af3a-4726-9842-81ade618f71b tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:28.761202 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-41e7b93f-af3a-4726-9842-81ade618f71b tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:28.770426 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-41e7b93f-af3a-4726-9842-81ade618f71b tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1266 microversion: 2.1 time: 0.173069 Sep 23 14:02:28.776634 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 13/31] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:28 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:28.916914 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Flavor limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:02:28.917631 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Image limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:02:28.918038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Flavor pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:02:28.918488 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Image pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:02:28.919153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:02:28.929701 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:28.930205 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:28.930687 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:28.931426 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:28.931973 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:28.932410 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:28.956339 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for project 482490c45ac64607bba9ad021f2effbf. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:02:28.961177 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for user 0db30f990aae49fabf9b8b19cd019de9 and project 482490c45ac64607bba9ad021f2effbf. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:02:28.976225 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Going to run 1 instances... {{(pid=121073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:02:28.978438 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:02:29.112983 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ad2d0633-599a-4b0c-98be-96124197d02e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.764715 Sep 23 14:02:29.113715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 19/32] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:02:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 2766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 14:02:29.128794 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-10912253-502a-4462-bfc8-839f1ceab2db tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:29.135295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-10912253-502a-4462-bfc8-839f1ceab2db tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:29.194166 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d5bc5c73-0095-4908-891c-9a963425e9f4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:29.194816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d5bc5c73-0095-4908-891c-9a963425e9f4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:29.210196 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d5bc5c73-0095-4908-891c-9a963425e9f4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:29.210735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d5bc5c73-0095-4908-891c-9a963425e9f4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:29.211180 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d5bc5c73-0095-4908-891c-9a963425e9f4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:29.211900 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d5bc5c73-0095-4908-891c-9a963425e9f4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:29.223261 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d5bc5c73-0095-4908-891c-9a963425e9f4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:29.223860 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d5bc5c73-0095-4908-891c-9a963425e9f4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:29.339392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-10912253-502a-4462-bfc8-839f1ceab2db tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:29.347724 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-10912253-502a-4462-bfc8-839f1ceab2db tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1241 microversion: 2.1 time: 0.224237 Sep 23 14:02:29.350517 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 14/33] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:29 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1241 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:29.558395 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d5bc5c73-0095-4908-891c-9a963425e9f4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:29.572987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d5bc5c73-0095-4908-891c-9a963425e9f4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1282 microversion: 2.1 time: 0.383698 Sep 23 14:02:29.577276 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 20/34] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:29 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1282 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:02:29.803518 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ec31e3b5-d3fa-482a-8ac4-faec48686edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:29.804383 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ec31e3b5-d3fa-482a-8ac4-faec48686edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:29.810217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ec31e3b5-d3fa-482a-8ac4-faec48686edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:29.810731 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ec31e3b5-d3fa-482a-8ac4-faec48686edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:29.811170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ec31e3b5-d3fa-482a-8ac4-faec48686edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:29.811954 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ec31e3b5-d3fa-482a-8ac4-faec48686edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:29.812413 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ec31e3b5-d3fa-482a-8ac4-faec48686edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:29.812931 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ec31e3b5-d3fa-482a-8ac4-faec48686edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:29.891939 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ec31e3b5-d3fa-482a-8ac4-faec48686edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:29.906522 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ec31e3b5-d3fa-482a-8ac4-faec48686edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1266 microversion: 2.1 time: 0.106923 Sep 23 14:02:29.909102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 15/35] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:29 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:30.376811 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-07787c3d-8de0-4b2b-80af-dbe1724263aa tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:30.377526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-07787c3d-8de0-4b2b-80af-dbe1724263aa tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:30.496950 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-07787c3d-8de0-4b2b-80af-dbe1724263aa tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:30.523193 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-07787c3d-8de0-4b2b-80af-dbe1724263aa tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1241 microversion: 2.1 time: 0.145417 Sep 23 14:02:30.527631 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 21/36] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:30 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1241 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:30.597318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-af8fa978-ad8f-488f-85f8-3badf8fb0609 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:30.597947 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-af8fa978-ad8f-488f-85f8-3badf8fb0609 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:30.626662 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-af8fa978-ad8f-488f-85f8-3badf8fb0609 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:30.628400 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-af8fa978-ad8f-488f-85f8-3badf8fb0609 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:30.628400 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-af8fa978-ad8f-488f-85f8-3badf8fb0609 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:30.628400 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-af8fa978-ad8f-488f-85f8-3badf8fb0609 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:30.628753 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-af8fa978-ad8f-488f-85f8-3badf8fb0609 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:30.629186 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-af8fa978-ad8f-488f-85f8-3badf8fb0609 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:30.849858 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-af8fa978-ad8f-488f-85f8-3badf8fb0609 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:30.871953 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-af8fa978-ad8f-488f-85f8-3badf8fb0609 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1282 microversion: 2.1 time: 0.265849 Sep 23 14:02:30.873115 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 16/37] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:30 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1282 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:30.931805 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a366d6e8-cb42-41d9-a9a3-5cbccf6c0c8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:30.942631 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a366d6e8-cb42-41d9-a9a3-5cbccf6c0c8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:30.974918 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a366d6e8-cb42-41d9-a9a3-5cbccf6c0c8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:30.978115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a366d6e8-cb42-41d9-a9a3-5cbccf6c0c8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:30.978859 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a366d6e8-cb42-41d9-a9a3-5cbccf6c0c8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:30.979807 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a366d6e8-cb42-41d9-a9a3-5cbccf6c0c8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:30.982016 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a366d6e8-cb42-41d9-a9a3-5cbccf6c0c8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:30.982687 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a366d6e8-cb42-41d9-a9a3-5cbccf6c0c8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:31.140942 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a366d6e8-cb42-41d9-a9a3-5cbccf6c0c8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:31.156377 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a366d6e8-cb42-41d9-a9a3-5cbccf6c0c8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1266 microversion: 2.1 time: 0.224788 Sep 23 14:02:31.156377 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 22/38] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:30 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:31.664619 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5e81a4e5-6267-43a6-8373-7ab39215cdf7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:31.664619 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-5e81a4e5-6267-43a6-8373-7ab39215cdf7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:31.664619 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5e81a4e5-6267-43a6-8373-7ab39215cdf7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:31.664619 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5e81a4e5-6267-43a6-8373-7ab39215cdf7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:31.666134 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5e81a4e5-6267-43a6-8373-7ab39215cdf7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:31.666134 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5e81a4e5-6267-43a6-8373-7ab39215cdf7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:31.666134 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5e81a4e5-6267-43a6-8373-7ab39215cdf7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:31.666134 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5e81a4e5-6267-43a6-8373-7ab39215cdf7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:31.666473 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5e81a4e5-6267-43a6-8373-7ab39215cdf7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:31.666473 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5e81a4e5-6267-43a6-8373-7ab39215cdf7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1237 microversion: 2.1 time: 0.112746 Sep 23 14:02:31.666473 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 17/39] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:31 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1237 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:31.917863 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-25cd37fa-b36e-4722-a46b-a830f603de34 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:31.917863 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-25cd37fa-b36e-4722-a46b-a830f603de34 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:31.917863 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-25cd37fa-b36e-4722-a46b-a830f603de34 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:31.917863 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-25cd37fa-b36e-4722-a46b-a830f603de34 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:31.918860 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-25cd37fa-b36e-4722-a46b-a830f603de34 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:31.918860 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-25cd37fa-b36e-4722-a46b-a830f603de34 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:31.918860 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-25cd37fa-b36e-4722-a46b-a830f603de34 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:31.918860 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-25cd37fa-b36e-4722-a46b-a830f603de34 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:31.994903 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-25cd37fa-b36e-4722-a46b-a830f603de34 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:32.004571 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-25cd37fa-b36e-4722-a46b-a830f603de34 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1280 microversion: 2.1 time: 0.112432 Sep 23 14:02:32.006081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 23/40] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:31 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1280 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:32.196851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-25a0440c-e59e-4359-ad91-157e0ced1e73 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:32.196851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-25a0440c-e59e-4359-ad91-157e0ced1e73 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:32.196851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25a0440c-e59e-4359-ad91-157e0ced1e73 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:32.196851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25a0440c-e59e-4359-ad91-157e0ced1e73 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:32.197680 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25a0440c-e59e-4359-ad91-157e0ced1e73 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:32.197680 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25a0440c-e59e-4359-ad91-157e0ced1e73 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:32.197680 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25a0440c-e59e-4359-ad91-157e0ced1e73 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:32.197680 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25a0440c-e59e-4359-ad91-157e0ced1e73 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:32.338941 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-25a0440c-e59e-4359-ad91-157e0ced1e73 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:32.348826 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-25a0440c-e59e-4359-ad91-157e0ced1e73 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1266 microversion: 2.1 time: 0.173607 Sep 23 14:02:32.378443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 18/41] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:32 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:32.693765 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f239a33f-5632-4794-831a-0b048a7541d9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:32.694710 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f239a33f-5632-4794-831a-0b048a7541d9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:32.701816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f239a33f-5632-4794-831a-0b048a7541d9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:32.702742 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f239a33f-5632-4794-831a-0b048a7541d9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:32.703397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f239a33f-5632-4794-831a-0b048a7541d9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:32.704310 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f239a33f-5632-4794-831a-0b048a7541d9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:32.704984 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f239a33f-5632-4794-831a-0b048a7541d9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:32.705622 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f239a33f-5632-4794-831a-0b048a7541d9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:32.830069 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f239a33f-5632-4794-831a-0b048a7541d9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:32.855794 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f239a33f-5632-4794-831a-0b048a7541d9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1293 microversion: 2.1 time: 0.165776 Sep 23 14:02:32.864001 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 24/42] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:32 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1293 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:33.043035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0bb21a5f-ac35-470c-86a2-d05d52c22ea7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:33.043648 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-0bb21a5f-ac35-470c-86a2-d05d52c22ea7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:33.050848 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0bb21a5f-ac35-470c-86a2-d05d52c22ea7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:33.057215 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0bb21a5f-ac35-470c-86a2-d05d52c22ea7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:33.057961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0bb21a5f-ac35-470c-86a2-d05d52c22ea7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:33.058789 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0bb21a5f-ac35-470c-86a2-d05d52c22ea7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:33.059410 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0bb21a5f-ac35-470c-86a2-d05d52c22ea7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:33.061295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0bb21a5f-ac35-470c-86a2-d05d52c22ea7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:33.167791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=4 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:33.379019 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5c6f1429-3b44-4502-aa1d-702df79157cb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:33.379587 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5c6f1429-3b44-4502-aa1d-702df79157cb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:33.398552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5c6f1429-3b44-4502-aa1d-702df79157cb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:33.399203 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5c6f1429-3b44-4502-aa1d-702df79157cb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:33.408657 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5c6f1429-3b44-4502-aa1d-702df79157cb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:33.408657 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5c6f1429-3b44-4502-aa1d-702df79157cb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:33.412025 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5c6f1429-3b44-4502-aa1d-702df79157cb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:33.413230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5c6f1429-3b44-4502-aa1d-702df79157cb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:34.403523 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5c6f1429-3b44-4502-aa1d-702df79157cb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:34.424034 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5c6f1429-3b44-4502-aa1d-702df79157cb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1272 microversion: 2.1 time: 1.049122 Sep 23 14:02:34.432163 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 25/43] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:33 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1272 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:34.463297 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8abfc579-cded-4411-8a3c-6adcc65a2d99 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:34.471564 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-8abfc579-cded-4411-8a3c-6adcc65a2d99 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:34.507181 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8abfc579-cded-4411-8a3c-6adcc65a2d99 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:34.509212 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8abfc579-cded-4411-8a3c-6adcc65a2d99 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:34.513883 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8abfc579-cded-4411-8a3c-6adcc65a2d99 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:34.516100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8abfc579-cded-4411-8a3c-6adcc65a2d99 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:34.517536 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8abfc579-cded-4411-8a3c-6adcc65a2d99 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:34.521871 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8abfc579-cded-4411-8a3c-6adcc65a2d99 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:34.777143 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-8abfc579-cded-4411-8a3c-6adcc65a2d99 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:34.783125 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-0bb21a5f-ac35-470c-86a2-d05d52c22ea7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:34.793008 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8abfc579-cded-4411-8a3c-6adcc65a2d99 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1311 microversion: 2.1 time: 0.359030 Sep 23 14:02:34.793565 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-0bb21a5f-ac35-470c-86a2-d05d52c22ea7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 1.754350 Sep 23 14:02:34.796910 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 26/44] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:34 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1311 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:34.801454 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 19/45] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:33 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:35.460744 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-11229bb7-d03f-443f-97a1-b8a67d0af3b7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:35.461472 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-11229bb7-d03f-443f-97a1-b8a67d0af3b7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:35.468889 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-11229bb7-d03f-443f-97a1-b8a67d0af3b7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:35.469993 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-11229bb7-d03f-443f-97a1-b8a67d0af3b7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:35.471012 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-11229bb7-d03f-443f-97a1-b8a67d0af3b7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:35.472196 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-11229bb7-d03f-443f-97a1-b8a67d0af3b7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:35.473120 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-11229bb7-d03f-443f-97a1-b8a67d0af3b7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:35.474295 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-11229bb7-d03f-443f-97a1-b8a67d0af3b7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:35.641324 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-11229bb7-d03f-443f-97a1-b8a67d0af3b7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:35.649666 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-11229bb7-d03f-443f-97a1-b8a67d0af3b7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.195447 Sep 23 14:02:35.654106 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 27/46] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:35 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:02:35.829356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-98cf6d1b-7899-43f8-9035-6a5cdc8f5272 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:35.831919 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-98cf6d1b-7899-43f8-9035-6a5cdc8f5272 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:35.857497 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-98cf6d1b-7899-43f8-9035-6a5cdc8f5272 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:35.858035 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-98cf6d1b-7899-43f8-9035-6a5cdc8f5272 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:35.858512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-98cf6d1b-7899-43f8-9035-6a5cdc8f5272 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:35.859235 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-98cf6d1b-7899-43f8-9035-6a5cdc8f5272 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:35.859729 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-98cf6d1b-7899-43f8-9035-6a5cdc8f5272 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:35.860160 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-98cf6d1b-7899-43f8-9035-6a5cdc8f5272 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:35.868571 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-a0c81215-c804-4b7b-a750-d4db5985d6c2 req-874be889-0c31-4dc4-94ad-800f7da3eb20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af91809-ccf1-4b46-8778-e073f385d6ef", "tag": "2ab6acdc-68c7-4e5c-85c7-bbf6ead5ade9"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:35.899165 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-a0c81215-c804-4b7b-a750-d4db5985d6c2 req-874be889-0c31-4dc4-94ad-800f7da3eb20 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:35.912529 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-a0c81215-c804-4b7b-a750-d4db5985d6c2 req-874be889-0c31-4dc4-94ad-800f7da3eb20 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:35.913484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-a0c81215-c804-4b7b-a750-d4db5985d6c2 req-874be889-0c31-4dc4-94ad-800f7da3eb20 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:35.960600 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-a0c81215-c804-4b7b-a750-d4db5985d6c2 req-874be889-0c31-4dc4-94ad-800f7da3eb20 service nova] Creating event network-changed:2ab6acdc-68c7-4e5c-85c7-bbf6ead5ade9 for instance 2af91809-ccf1-4b46-8778-e073f385d6ef on hv-cinder-85743 Sep 23 14:02:35.961558 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-a0c81215-c804-4b7b-a750-d4db5985d6c2 req-874be889-0c31-4dc4-94ad-800f7da3eb20 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121074) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 14:02:35.962062 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-a0c81215-c804-4b7b-a750-d4db5985d6c2 req-874be889-0c31-4dc4-94ad-800f7da3eb20 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121074) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 14:02:35.963384 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7aa02fa6-14d6-4951-9a40-646f045a2065 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:35.964106 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7aa02fa6-14d6-4951-9a40-646f045a2065 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:35.965254 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7aa02fa6-14d6-4951-9a40-646f045a2065 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:35.966224 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7aa02fa6-14d6-4951-9a40-646f045a2065 None None] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:35.966895 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7aa02fa6-14d6-4951-9a40-646f045a2065 None None] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:35.967524 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7aa02fa6-14d6-4951-9a40-646f045a2065 None None] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:35.978863 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.compute.rpcapi [None req-7aa02fa6-14d6-4951-9a40-646f045a2065 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 23 14:02:35.979854 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7aa02fa6-14d6-4951-9a40-646f045a2065 None None] Releasing lock "compute-rpcapi-router" {{(pid=121074) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 14:02:35.997566 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7aa02fa6-14d6-4951-9a40-646f045a2065 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490750 Sep 23 14:02:35.999467 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 20/47] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:02:36.005776 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5d13be60-ab6d-46b4-85c6-9353322e3f6c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:36.007253 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-5d13be60-ab6d-46b4-85c6-9353322e3f6c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:36.013092 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d13be60-ab6d-46b4-85c6-9353322e3f6c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:36.013784 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d13be60-ab6d-46b4-85c6-9353322e3f6c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:36.014425 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d13be60-ab6d-46b4-85c6-9353322e3f6c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:36.015472 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d13be60-ab6d-46b4-85c6-9353322e3f6c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:36.016433 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d13be60-ab6d-46b4-85c6-9353322e3f6c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:36.017641 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d13be60-ab6d-46b4-85c6-9353322e3f6c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:36.078428 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-98cf6d1b-7899-43f8-9035-6a5cdc8f5272 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:36.089845 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-98cf6d1b-7899-43f8-9035-6a5cdc8f5272 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.265162 Sep 23 14:02:36.090466 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 28/48] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:35 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:36.123112 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5d13be60-ab6d-46b4-85c6-9353322e3f6c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:36.135422 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5d13be60-ab6d-46b4-85c6-9353322e3f6c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1299 microversion: 2.1 time: 0.131650 Sep 23 14:02:36.135422 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 21/49] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:35 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:36.673849 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ab56cfe9-bbd3-476c-b5b7-a0033dc384f2 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:36.674552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ab56cfe9-bbd3-476c-b5b7-a0033dc384f2 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:36.681966 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab56cfe9-bbd3-476c-b5b7-a0033dc384f2 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:36.682561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab56cfe9-bbd3-476c-b5b7-a0033dc384f2 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:36.683165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab56cfe9-bbd3-476c-b5b7-a0033dc384f2 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:36.683745 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab56cfe9-bbd3-476c-b5b7-a0033dc384f2 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:36.684209 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab56cfe9-bbd3-476c-b5b7-a0033dc384f2 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:36.684637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab56cfe9-bbd3-476c-b5b7-a0033dc384f2 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:36.825489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ab56cfe9-bbd3-476c-b5b7-a0033dc384f2 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:36.834943 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ab56cfe9-bbd3-476c-b5b7-a0033dc384f2 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.164875 Sep 23 14:02:36.835469 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 29/50] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:36 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:37.114987 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fb4ac176-7685-4435-bf18-c9f0f440b61e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:37.115752 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-fb4ac176-7685-4435-bf18-c9f0f440b61e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:37.118178 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:37.125264 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fb4ac176-7685-4435-bf18-c9f0f440b61e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:37.125264 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fb4ac176-7685-4435-bf18-c9f0f440b61e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:37.125264 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fb4ac176-7685-4435-bf18-c9f0f440b61e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:37.125852 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fb4ac176-7685-4435-bf18-c9f0f440b61e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:37.126355 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fb4ac176-7685-4435-bf18-c9f0f440b61e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:37.126790 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fb4ac176-7685-4435-bf18-c9f0f440b61e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:37.160094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ed76b7d6-7228-44ca-ba04-7d590ac3c623 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:37.160709 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ed76b7d6-7228-44ca-ba04-7d590ac3c623 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:37.173013 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ed76b7d6-7228-44ca-ba04-7d590ac3c623 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:37.173504 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ed76b7d6-7228-44ca-ba04-7d590ac3c623 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:37.173934 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ed76b7d6-7228-44ca-ba04-7d590ac3c623 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:37.174667 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ed76b7d6-7228-44ca-ba04-7d590ac3c623 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:37.175120 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ed76b7d6-7228-44ca-ba04-7d590ac3c623 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:37.175571 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ed76b7d6-7228-44ca-ba04-7d590ac3c623 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:37.267822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ed76b7d6-7228-44ca-ba04-7d590ac3c623 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:37.279148 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ed76b7d6-7228-44ca-ba04-7d590ac3c623 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1299 microversion: 2.1 time: 0.122885 Sep 23 14:02:37.279834 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 30/51] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:37 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:02:37.312966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fb4ac176-7685-4435-bf18-c9f0f440b61e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:37.321505 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fb4ac176-7685-4435-bf18-c9f0f440b61e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.210598 Sep 23 14:02:37.322074 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 22/52] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:37 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:37.859707 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5bf08eed-99ce-4d29-a5b7-f16179812273 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:37.860719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5bf08eed-99ce-4d29-a5b7-f16179812273 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:37.869566 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bf08eed-99ce-4d29-a5b7-f16179812273 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:37.870073 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bf08eed-99ce-4d29-a5b7-f16179812273 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:37.870722 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bf08eed-99ce-4d29-a5b7-f16179812273 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:37.871445 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bf08eed-99ce-4d29-a5b7-f16179812273 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:37.871914 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bf08eed-99ce-4d29-a5b7-f16179812273 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:37.872341 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bf08eed-99ce-4d29-a5b7-f16179812273 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:38.017377 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-f11d7b06-cd36-4d67-979c-6c089255ce82 req-346fbe00-a795-41d2-9921-7159074b9229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ff0e5b-c9cf-409f-a993-a5969225c7bf", "tag": "08c333a2-80db-4cb2-8c18-245c61e87e9a"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:38.036452 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f11d7b06-cd36-4d67-979c-6c089255ce82 req-346fbe00-a795-41d2-9921-7159074b9229 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:38.037467 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f11d7b06-cd36-4d67-979c-6c089255ce82 req-346fbe00-a795-41d2-9921-7159074b9229 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:38.038268 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f11d7b06-cd36-4d67-979c-6c089255ce82 req-346fbe00-a795-41d2-9921-7159074b9229 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:38.066936 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-f11d7b06-cd36-4d67-979c-6c089255ce82 req-346fbe00-a795-41d2-9921-7159074b9229 service nova] Creating event network-changed:08c333a2-80db-4cb2-8c18-245c61e87e9a for instance 00ff0e5b-c9cf-409f-a993-a5969225c7bf on hv-cinder-85743 Sep 23 14:02:38.074538 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-f11d7b06-cd36-4d67-979c-6c089255ce82 req-346fbe00-a795-41d2-9921-7159074b9229 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062505 Sep 23 14:02:38.076301 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 23/53] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:02:38.117140 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5bf08eed-99ce-4d29-a5b7-f16179812273 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:38.148067 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5bf08eed-99ce-4d29-a5b7-f16179812273 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.289358 Sep 23 14:02:38.151570 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 31/54] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:37 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:38.305468 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-04aac39e-c500-4001-a33d-371e7f49bac4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:38.306168 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-04aac39e-c500-4001-a33d-371e7f49bac4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:38.318837 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04aac39e-c500-4001-a33d-371e7f49bac4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:38.321254 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04aac39e-c500-4001-a33d-371e7f49bac4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:38.321700 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04aac39e-c500-4001-a33d-371e7f49bac4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:38.322442 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04aac39e-c500-4001-a33d-371e7f49bac4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:38.322899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04aac39e-c500-4001-a33d-371e7f49bac4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:38.326607 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04aac39e-c500-4001-a33d-371e7f49bac4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:38.345140 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4de7ce79-790c-4156-9811-d99f19d7b6cc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:38.345979 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4de7ce79-790c-4156-9811-d99f19d7b6cc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:38.369576 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4de7ce79-790c-4156-9811-d99f19d7b6cc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:38.371920 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4de7ce79-790c-4156-9811-d99f19d7b6cc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:38.377458 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4de7ce79-790c-4156-9811-d99f19d7b6cc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:38.377458 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4de7ce79-790c-4156-9811-d99f19d7b6cc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:38.377458 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4de7ce79-790c-4156-9811-d99f19d7b6cc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:38.377458 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4de7ce79-790c-4156-9811-d99f19d7b6cc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:38.498646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-04aac39e-c500-4001-a33d-371e7f49bac4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:38.516290 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-04aac39e-c500-4001-a33d-371e7f49bac4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1299 microversion: 2.1 time: 0.209373 Sep 23 14:02:38.526966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 24/55] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:38 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:38.646558 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4de7ce79-790c-4156-9811-d99f19d7b6cc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:38.656842 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4de7ce79-790c-4156-9811-d99f19d7b6cc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.315443 Sep 23 14:02:38.657901 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 32/56] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:38 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:39.174844 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7d9b7018-1cd6-4f45-9747-b528e473563e tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:39.175879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7d9b7018-1cd6-4f45-9747-b528e473563e tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:39.186089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7d9b7018-1cd6-4f45-9747-b528e473563e tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:39.186960 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7d9b7018-1cd6-4f45-9747-b528e473563e tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:39.187580 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7d9b7018-1cd6-4f45-9747-b528e473563e tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:39.189748 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7d9b7018-1cd6-4f45-9747-b528e473563e tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:39.190527 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7d9b7018-1cd6-4f45-9747-b528e473563e tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:39.191339 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7d9b7018-1cd6-4f45-9747-b528e473563e tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:39.347565 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=22 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:39.391950 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7d9b7018-1cd6-4f45-9747-b528e473563e tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:39.400948 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7d9b7018-1cd6-4f45-9747-b528e473563e tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.229815 Sep 23 14:02:39.405550 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 25/57] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:39 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:39.533345 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-249104e2-0417-4f11-bf81-fb9fa66bd1d7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:39.533980 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-249104e2-0417-4f11-bf81-fb9fa66bd1d7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:39.536203 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=4 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:39.541748 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-249104e2-0417-4f11-bf81-fb9fa66bd1d7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:39.542246 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-249104e2-0417-4f11-bf81-fb9fa66bd1d7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:39.542706 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-249104e2-0417-4f11-bf81-fb9fa66bd1d7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:39.543403 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-249104e2-0417-4f11-bf81-fb9fa66bd1d7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:39.544027 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-249104e2-0417-4f11-bf81-fb9fa66bd1d7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:39.544768 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-249104e2-0417-4f11-bf81-fb9fa66bd1d7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:39.662121 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-249104e2-0417-4f11-bf81-fb9fa66bd1d7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:39.680721 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-249104e2-0417-4f11-bf81-fb9fa66bd1d7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1299 microversion: 2.1 time: 0.151429 Sep 23 14:02:39.682662 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-479b7f17-986a-45cc-b1c3-71b69a5a89a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:39.683743 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-479b7f17-986a-45cc-b1c3-71b69a5a89a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:39.691422 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-479b7f17-986a-45cc-b1c3-71b69a5a89a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:39.695285 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-479b7f17-986a-45cc-b1c3-71b69a5a89a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:39.695285 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-479b7f17-986a-45cc-b1c3-71b69a5a89a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:39.695285 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-479b7f17-986a-45cc-b1c3-71b69a5a89a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:39.695285 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-479b7f17-986a-45cc-b1c3-71b69a5a89a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:39.695625 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-479b7f17-986a-45cc-b1c3-71b69a5a89a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:39.702554 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 33/58] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:39 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1299 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:39.919799 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-479b7f17-986a-45cc-b1c3-71b69a5a89a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:39.929985 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-479b7f17-986a-45cc-b1c3-71b69a5a89a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.252089 Sep 23 14:02:39.945991 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 26/59] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:39 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:02:40.430660 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-662ee943-e8f0-43eb-b180-174a97368b8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:40.431668 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-662ee943-e8f0-43eb-b180-174a97368b8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:40.438758 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-662ee943-e8f0-43eb-b180-174a97368b8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:40.439363 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-662ee943-e8f0-43eb-b180-174a97368b8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:40.440087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-662ee943-e8f0-43eb-b180-174a97368b8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:40.440924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-662ee943-e8f0-43eb-b180-174a97368b8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:40.441455 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-662ee943-e8f0-43eb-b180-174a97368b8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:40.442217 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-662ee943-e8f0-43eb-b180-174a97368b8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:40.514861 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=20 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:40.711160 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f50c3d5e-2a2b-4f23-9175-11763cab2821 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:40.711160 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f50c3d5e-2a2b-4f23-9175-11763cab2821 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:40.725040 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f50c3d5e-2a2b-4f23-9175-11763cab2821 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:40.725542 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f50c3d5e-2a2b-4f23-9175-11763cab2821 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:40.725980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f50c3d5e-2a2b-4f23-9175-11763cab2821 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:40.726989 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f50c3d5e-2a2b-4f23-9175-11763cab2821 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:40.727594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f50c3d5e-2a2b-4f23-9175-11763cab2821 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:40.728384 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f50c3d5e-2a2b-4f23-9175-11763cab2821 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:40.761062 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-662ee943-e8f0-43eb-b180-174a97368b8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:40.772809 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-662ee943-e8f0-43eb-b180-174a97368b8d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.346353 Sep 23 14:02:40.772809 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 34/60] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:40 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:40.843186 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f50c3d5e-2a2b-4f23-9175-11763cab2821 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:40.859523 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f50c3d5e-2a2b-4f23-9175-11763cab2821 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1299 microversion: 2.1 time: 0.158206 Sep 23 14:02:40.874742 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 27/61] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:40 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1299 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:40.954070 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1e7864bf-f2d2-4b4f-b6e2-46c8ae681ca9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:40.956210 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1e7864bf-f2d2-4b4f-b6e2-46c8ae681ca9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:40.970220 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1e7864bf-f2d2-4b4f-b6e2-46c8ae681ca9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:40.971508 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1e7864bf-f2d2-4b4f-b6e2-46c8ae681ca9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:40.972390 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1e7864bf-f2d2-4b4f-b6e2-46c8ae681ca9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:40.973681 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1e7864bf-f2d2-4b4f-b6e2-46c8ae681ca9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:40.976685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1e7864bf-f2d2-4b4f-b6e2-46c8ae681ca9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:40.980265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1e7864bf-f2d2-4b4f-b6e2-46c8ae681ca9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:41.647448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1e7864bf-f2d2-4b4f-b6e2-46c8ae681ca9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:41.657428 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1e7864bf-f2d2-4b4f-b6e2-46c8ae681ca9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.707976 Sep 23 14:02:41.662978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 35/62] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:40 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:41.797936 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-98e6397c-f02b-4a21-8b9e-1cbff8dc7adf tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:41.799371 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-98e6397c-f02b-4a21-8b9e-1cbff8dc7adf tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:41.807343 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-98e6397c-f02b-4a21-8b9e-1cbff8dc7adf tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:41.808124 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-98e6397c-f02b-4a21-8b9e-1cbff8dc7adf tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:41.808724 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-98e6397c-f02b-4a21-8b9e-1cbff8dc7adf tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:41.809788 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-98e6397c-f02b-4a21-8b9e-1cbff8dc7adf tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:41.810264 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-98e6397c-f02b-4a21-8b9e-1cbff8dc7adf tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:41.810809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-98e6397c-f02b-4a21-8b9e-1cbff8dc7adf tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:41.891175 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-494bc383-90f3-419e-b4d4-5b2f71eeaa4e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:41.892506 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-494bc383-90f3-419e-b4d4-5b2f71eeaa4e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:41.903056 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-494bc383-90f3-419e-b4d4-5b2f71eeaa4e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:41.904749 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-494bc383-90f3-419e-b4d4-5b2f71eeaa4e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:41.905616 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-494bc383-90f3-419e-b4d4-5b2f71eeaa4e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:41.907218 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-494bc383-90f3-419e-b4d4-5b2f71eeaa4e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:41.910156 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-494bc383-90f3-419e-b4d4-5b2f71eeaa4e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:41.910919 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-494bc383-90f3-419e-b4d4-5b2f71eeaa4e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:42.151163 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-494bc383-90f3-419e-b4d4-5b2f71eeaa4e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:42.155190 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=100 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:42.159428 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-494bc383-90f3-419e-b4d4-5b2f71eeaa4e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1299 microversion: 2.1 time: 0.272182 Sep 23 14:02:42.174804 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 36/63] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:41 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1299 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:02:42.401728 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-98e6397c-f02b-4a21-8b9e-1cbff8dc7adf tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:42.410950 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=100 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:42.418779 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-98e6397c-f02b-4a21-8b9e-1cbff8dc7adf tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.623741 Sep 23 14:02:42.442121 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 28/64] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:41 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:02:42.695604 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c60bafe0-a71c-4549-8948-4ed7a1627a54 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:42.696586 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c60bafe0-a71c-4549-8948-4ed7a1627a54 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:42.704208 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c60bafe0-a71c-4549-8948-4ed7a1627a54 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:42.704707 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c60bafe0-a71c-4549-8948-4ed7a1627a54 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:42.705146 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c60bafe0-a71c-4549-8948-4ed7a1627a54 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:42.705940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c60bafe0-a71c-4549-8948-4ed7a1627a54 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:42.706570 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c60bafe0-a71c-4549-8948-4ed7a1627a54 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:42.707001 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c60bafe0-a71c-4549-8948-4ed7a1627a54 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:43.040144 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c60bafe0-a71c-4549-8948-4ed7a1627a54 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:43.056135 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c60bafe0-a71c-4549-8948-4ed7a1627a54 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.367935 Sep 23 14:02:43.056725 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 37/65] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:42 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:43.184130 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-120acfa5-a5d1-4d19-a8c6-74051970ea7c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:43.186592 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-120acfa5-a5d1-4d19-a8c6-74051970ea7c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:43.195129 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-120acfa5-a5d1-4d19-a8c6-74051970ea7c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:43.195658 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-120acfa5-a5d1-4d19-a8c6-74051970ea7c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:43.196100 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-120acfa5-a5d1-4d19-a8c6-74051970ea7c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:43.196985 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-120acfa5-a5d1-4d19-a8c6-74051970ea7c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:43.197820 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-120acfa5-a5d1-4d19-a8c6-74051970ea7c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:43.198675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-120acfa5-a5d1-4d19-a8c6-74051970ea7c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:43.363049 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-120acfa5-a5d1-4d19-a8c6-74051970ea7c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:43.366481 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-dd8155c2-5551-4441-8e7e-d1bae2a78c59 req-dde4da6b-3f9f-4445-8d27-3970883c1c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc990d71-8d2f-4734-a5b2-4401f24cc5b4", "tag": "b4188b8d-6da8-4e12-b11f-025e11d549d5"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:43.374558 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-120acfa5-a5d1-4d19-a8c6-74051970ea7c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1367 microversion: 2.1 time: 0.196354 Sep 23 14:02:43.382876 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-dd8155c2-5551-4441-8e7e-d1bae2a78c59 req-dde4da6b-3f9f-4445-8d27-3970883c1c75 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:43.383633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-dd8155c2-5551-4441-8e7e-d1bae2a78c59 req-dde4da6b-3f9f-4445-8d27-3970883c1c75 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:43.384220 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-dd8155c2-5551-4441-8e7e-d1bae2a78c59 req-dde4da6b-3f9f-4445-8d27-3970883c1c75 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:43.388129 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 29/66] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:43 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:43.407515 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-dd8155c2-5551-4441-8e7e-d1bae2a78c59 req-dde4da6b-3f9f-4445-8d27-3970883c1c75 service nova] Creating event network-changed:b4188b8d-6da8-4e12-b11f-025e11d549d5 for instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 on hv-cinder-85743 Sep 23 14:02:43.408637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-dd8155c2-5551-4441-8e7e-d1bae2a78c59 req-dde4da6b-3f9f-4445-8d27-3970883c1c75 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 14:02:43.409099 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-dd8155c2-5551-4441-8e7e-d1bae2a78c59 req-dde4da6b-3f9f-4445-8d27-3970883c1c75 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 14:02:43.410201 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-43335bef-9e6e-4946-899c-984b4ea09ebf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:43.411427 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-43335bef-9e6e-4946-899c-984b4ea09ebf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:43.416776 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-43335bef-9e6e-4946-899c-984b4ea09ebf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:43.416776 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-43335bef-9e6e-4946-899c-984b4ea09ebf None None] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:43.416776 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-43335bef-9e6e-4946-899c-984b4ea09ebf None None] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:43.416776 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-43335bef-9e6e-4946-899c-984b4ea09ebf None None] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:43.422463 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.compute.rpcapi [None req-43335bef-9e6e-4946-899c-984b4ea09ebf None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 23 14:02:43.423477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-43335bef-9e6e-4946-899c-984b4ea09ebf None None] Releasing lock "compute-rpcapi-router" {{(pid=121073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 14:02:43.441215 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-43335bef-9e6e-4946-899c-984b4ea09ebf None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259484 Sep 23 14:02:43.441859 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 38/67] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:02:43.467700 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8c6be7c6-a025-4b5c-a093-4a5d44896ccc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:43.468403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8c6be7c6-a025-4b5c-a093-4a5d44896ccc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:43.474913 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c6be7c6-a025-4b5c-a093-4a5d44896ccc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:43.475759 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c6be7c6-a025-4b5c-a093-4a5d44896ccc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:43.475915 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c6be7c6-a025-4b5c-a093-4a5d44896ccc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:43.476509 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c6be7c6-a025-4b5c-a093-4a5d44896ccc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:43.476966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c6be7c6-a025-4b5c-a093-4a5d44896ccc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:43.477394 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c6be7c6-a025-4b5c-a093-4a5d44896ccc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:43.655320 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8c6be7c6-a025-4b5c-a093-4a5d44896ccc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:43.667850 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8c6be7c6-a025-4b5c-a093-4a5d44896ccc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.203297 Sep 23 14:02:43.668794 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 30/68] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:43 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:44.081232 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-7dc076a6-dd1e-4dca-ad8b-82db9ad3a5fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:44.082007 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-7dc076a6-dd1e-4dca-ad8b-82db9ad3a5fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:44.095317 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7dc076a6-dd1e-4dca-ad8b-82db9ad3a5fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:44.096018 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7dc076a6-dd1e-4dca-ad8b-82db9ad3a5fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:44.096118 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7dc076a6-dd1e-4dca-ad8b-82db9ad3a5fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:44.098696 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7dc076a6-dd1e-4dca-ad8b-82db9ad3a5fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:44.105487 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7dc076a6-dd1e-4dca-ad8b-82db9ad3a5fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:44.106253 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7dc076a6-dd1e-4dca-ad8b-82db9ad3a5fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:44.273367 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-7dc076a6-dd1e-4dca-ad8b-82db9ad3a5fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:44.280669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-7dc076a6-dd1e-4dca-ad8b-82db9ad3a5fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.203911 Sep 23 14:02:44.281765 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 39/69] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:44 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:44.408909 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-53b8fcee-7dff-4adc-a589-0b5ac586e185 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:44.412157 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-53b8fcee-7dff-4adc-a589-0b5ac586e185 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:44.428572 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-53b8fcee-7dff-4adc-a589-0b5ac586e185 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:44.428572 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-53b8fcee-7dff-4adc-a589-0b5ac586e185 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:44.428572 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-53b8fcee-7dff-4adc-a589-0b5ac586e185 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:44.428572 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-53b8fcee-7dff-4adc-a589-0b5ac586e185 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:44.428839 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-53b8fcee-7dff-4adc-a589-0b5ac586e185 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:44.428839 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-53b8fcee-7dff-4adc-a589-0b5ac586e185 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:44.604751 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-53b8fcee-7dff-4adc-a589-0b5ac586e185 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:44.623025 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-53b8fcee-7dff-4adc-a589-0b5ac586e185 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1367 microversion: 2.1 time: 0.218516 Sep 23 14:02:44.624021 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 31/70] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:44 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:44.697824 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-91df72eb-1768-44a1-9dfa-f2294150efbb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:44.698661 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-91df72eb-1768-44a1-9dfa-f2294150efbb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:44.705735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-91df72eb-1768-44a1-9dfa-f2294150efbb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:44.707878 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-91df72eb-1768-44a1-9dfa-f2294150efbb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:44.707878 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-91df72eb-1768-44a1-9dfa-f2294150efbb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:44.711102 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-91df72eb-1768-44a1-9dfa-f2294150efbb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:44.711721 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-91df72eb-1768-44a1-9dfa-f2294150efbb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:44.712386 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-91df72eb-1768-44a1-9dfa-f2294150efbb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:44.882612 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-91df72eb-1768-44a1-9dfa-f2294150efbb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:44.900213 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-91df72eb-1768-44a1-9dfa-f2294150efbb tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.207253 Sep 23 14:02:44.901387 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 40/71] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:44 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:45.307469 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6cb48902-1acc-4475-848d-add2322ad25a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:45.308717 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6cb48902-1acc-4475-848d-add2322ad25a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:45.315328 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6cb48902-1acc-4475-848d-add2322ad25a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:45.315938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6cb48902-1acc-4475-848d-add2322ad25a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:45.316500 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6cb48902-1acc-4475-848d-add2322ad25a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:45.317565 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6cb48902-1acc-4475-848d-add2322ad25a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:45.318110 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6cb48902-1acc-4475-848d-add2322ad25a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:45.318689 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6cb48902-1acc-4475-848d-add2322ad25a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:45.671617 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6cb48902-1acc-4475-848d-add2322ad25a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:45.671617 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6cb48902-1acc-4475-848d-add2322ad25a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.191079 Sep 23 14:02:45.671617 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 32/72] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:45 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:45.673411 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-eaaf4347-0fac-45ec-9177-1ada7909ba9a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:45.673411 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-eaaf4347-0fac-45ec-9177-1ada7909ba9a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:45.673411 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-eaaf4347-0fac-45ec-9177-1ada7909ba9a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:45.673411 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-eaaf4347-0fac-45ec-9177-1ada7909ba9a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:45.676113 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-eaaf4347-0fac-45ec-9177-1ada7909ba9a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:45.676113 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-eaaf4347-0fac-45ec-9177-1ada7909ba9a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:45.676113 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-eaaf4347-0fac-45ec-9177-1ada7909ba9a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:45.676113 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-eaaf4347-0fac-45ec-9177-1ada7909ba9a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:45.833231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-eaaf4347-0fac-45ec-9177-1ada7909ba9a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:45.841488 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-eaaf4347-0fac-45ec-9177-1ada7909ba9a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1367 microversion: 2.1 time: 0.197222 Sep 23 14:02:45.842114 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 41/73] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:45 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:45.924671 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f067fb8f-f563-4fd8-be73-2a0da2ddc28a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:45.925313 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f067fb8f-f563-4fd8-be73-2a0da2ddc28a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:45.931938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f067fb8f-f563-4fd8-be73-2a0da2ddc28a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:45.932457 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f067fb8f-f563-4fd8-be73-2a0da2ddc28a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:45.932891 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f067fb8f-f563-4fd8-be73-2a0da2ddc28a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:45.933573 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f067fb8f-f563-4fd8-be73-2a0da2ddc28a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:45.934023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f067fb8f-f563-4fd8-be73-2a0da2ddc28a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:45.934480 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f067fb8f-f563-4fd8-be73-2a0da2ddc28a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:45.976577 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:46.064901 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f067fb8f-f563-4fd8-be73-2a0da2ddc28a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:46.072968 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f067fb8f-f563-4fd8-be73-2a0da2ddc28a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.152846 Sep 23 14:02:46.073518 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 33/74] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:45 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:46.683254 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6aa463b0-98f9-49ba-bd40-7b50dacf8cca tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:46.684221 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-6aa463b0-98f9-49ba-bd40-7b50dacf8cca tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:46.689870 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6aa463b0-98f9-49ba-bd40-7b50dacf8cca tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:46.690637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6aa463b0-98f9-49ba-bd40-7b50dacf8cca tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:46.691142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6aa463b0-98f9-49ba-bd40-7b50dacf8cca tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:46.692533 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6aa463b0-98f9-49ba-bd40-7b50dacf8cca tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:46.693206 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6aa463b0-98f9-49ba-bd40-7b50dacf8cca tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:46.693771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6aa463b0-98f9-49ba-bd40-7b50dacf8cca tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:46.836648 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-6aa463b0-98f9-49ba-bd40-7b50dacf8cca tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:46.847119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-6aa463b0-98f9-49ba-bd40-7b50dacf8cca tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.165145 Sep 23 14:02:46.847119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 42/75] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:46 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:46.876110 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-99047a54-9948-4447-abf6-a3294ef939bb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:46.876110 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-99047a54-9948-4447-abf6-a3294ef939bb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:46.892444 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-99047a54-9948-4447-abf6-a3294ef939bb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:46.892950 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-99047a54-9948-4447-abf6-a3294ef939bb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:46.893389 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-99047a54-9948-4447-abf6-a3294ef939bb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:46.894097 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-99047a54-9948-4447-abf6-a3294ef939bb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:46.894620 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-99047a54-9948-4447-abf6-a3294ef939bb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:46.896196 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-99047a54-9948-4447-abf6-a3294ef939bb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:47.034806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-99047a54-9948-4447-abf6-a3294ef939bb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:47.044033 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-99047a54-9948-4447-abf6-a3294ef939bb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1367 microversion: 2.1 time: 0.182777 Sep 23 14:02:47.044915 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 34/76] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:46 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:47.095996 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ca904e4a-a6d2-443b-b335-8c7071a797fe tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:47.096617 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ca904e4a-a6d2-443b-b335-8c7071a797fe tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:47.103298 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca904e4a-a6d2-443b-b335-8c7071a797fe tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:47.103792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca904e4a-a6d2-443b-b335-8c7071a797fe tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:47.104235 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca904e4a-a6d2-443b-b335-8c7071a797fe tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:47.104926 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca904e4a-a6d2-443b-b335-8c7071a797fe tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:47.105389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca904e4a-a6d2-443b-b335-8c7071a797fe tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:47.105816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca904e4a-a6d2-443b-b335-8c7071a797fe tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:47.254427 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ca904e4a-a6d2-443b-b335-8c7071a797fe tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:47.261185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ca904e4a-a6d2-443b-b335-8c7071a797fe tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.168932 Sep 23 14:02:47.266040 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 43/77] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:47 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:47.870596 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4a33c39e-b3b8-4b51-a9d2-870f44330f88 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:47.871658 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4a33c39e-b3b8-4b51-a9d2-870f44330f88 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:47.897715 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4a33c39e-b3b8-4b51-a9d2-870f44330f88 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:47.897715 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4a33c39e-b3b8-4b51-a9d2-870f44330f88 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:47.897715 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4a33c39e-b3b8-4b51-a9d2-870f44330f88 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:47.897715 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4a33c39e-b3b8-4b51-a9d2-870f44330f88 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:47.898537 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4a33c39e-b3b8-4b51-a9d2-870f44330f88 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:47.898537 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4a33c39e-b3b8-4b51-a9d2-870f44330f88 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:48.029525 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4a33c39e-b3b8-4b51-a9d2-870f44330f88 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:48.037126 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4a33c39e-b3b8-4b51-a9d2-870f44330f88 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.171618 Sep 23 14:02:48.041523 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 35/78] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:47 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:48.076921 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ae524936-f2d8-4c17-8225-93a457880b73 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:48.077751 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ae524936-f2d8-4c17-8225-93a457880b73 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:48.084520 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ae524936-f2d8-4c17-8225-93a457880b73 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:48.085013 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ae524936-f2d8-4c17-8225-93a457880b73 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:48.085470 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ae524936-f2d8-4c17-8225-93a457880b73 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:48.086144 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ae524936-f2d8-4c17-8225-93a457880b73 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:48.089791 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ae524936-f2d8-4c17-8225-93a457880b73 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:48.089791 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ae524936-f2d8-4c17-8225-93a457880b73 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:48.288822 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-17d54440-41b9-4176-8363-857b711a2614 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:48.289443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-17d54440-41b9-4176-8363-857b711a2614 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:48.304556 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-17d54440-41b9-4176-8363-857b711a2614 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:48.305444 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-17d54440-41b9-4176-8363-857b711a2614 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:48.306034 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-17d54440-41b9-4176-8363-857b711a2614 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:48.307592 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-17d54440-41b9-4176-8363-857b711a2614 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:48.309779 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-17d54440-41b9-4176-8363-857b711a2614 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:48.310468 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-17d54440-41b9-4176-8363-857b711a2614 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:48.643972 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ae524936-f2d8-4c17-8225-93a457880b73 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:48.652117 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ae524936-f2d8-4c17-8225-93a457880b73 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1367 microversion: 2.1 time: 0.578941 Sep 23 14:02:48.653302 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 44/79] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:48 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1367 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:48.920262 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-17d54440-41b9-4176-8363-857b711a2614 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:48.929820 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-17d54440-41b9-4176-8363-857b711a2614 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.646364 Sep 23 14:02:48.930429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 36/80] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:48 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:49.065628 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a2bb5d00-40da-45cd-874e-fd8a9d295dec tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:49.067159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a2bb5d00-40da-45cd-874e-fd8a9d295dec tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:49.070496 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:49.080079 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a2bb5d00-40da-45cd-874e-fd8a9d295dec tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:49.083586 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a2bb5d00-40da-45cd-874e-fd8a9d295dec tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:49.083586 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a2bb5d00-40da-45cd-874e-fd8a9d295dec tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:49.083586 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a2bb5d00-40da-45cd-874e-fd8a9d295dec tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:49.084915 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a2bb5d00-40da-45cd-874e-fd8a9d295dec tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:49.085357 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a2bb5d00-40da-45cd-874e-fd8a9d295dec tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:49.329046 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a2bb5d00-40da-45cd-874e-fd8a9d295dec tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:49.338568 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a2bb5d00-40da-45cd-874e-fd8a9d295dec tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.277777 Sep 23 14:02:49.339169 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 45/81] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:49 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:49.681949 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ab522074-e5ef-48b3-8529-bb463ca7459b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:49.683624 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ab522074-e5ef-48b3-8529-bb463ca7459b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:49.694441 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ab522074-e5ef-48b3-8529-bb463ca7459b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:49.701359 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ab522074-e5ef-48b3-8529-bb463ca7459b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:49.701359 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ab522074-e5ef-48b3-8529-bb463ca7459b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:49.701359 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ab522074-e5ef-48b3-8529-bb463ca7459b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:49.701359 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ab522074-e5ef-48b3-8529-bb463ca7459b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:49.701876 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ab522074-e5ef-48b3-8529-bb463ca7459b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:49.904742 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-e977c95e-bda4-4482-80a4-a0e3327438a6 req-ec13ae54-364d-465f-9bc3-6179502445db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b6d10ec-d6f4-4d14-939c-beab0c9ba13b", "tag": "8fa468b7-9788-436b-98a3-9a8ce2151269"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:49.926052 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-e977c95e-bda4-4482-80a4-a0e3327438a6 req-ec13ae54-364d-465f-9bc3-6179502445db service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:49.926052 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-e977c95e-bda4-4482-80a4-a0e3327438a6 req-ec13ae54-364d-465f-9bc3-6179502445db service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:49.926052 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-e977c95e-bda4-4482-80a4-a0e3327438a6 req-ec13ae54-364d-465f-9bc3-6179502445db service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:49.936691 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-e977c95e-bda4-4482-80a4-a0e3327438a6 req-ec13ae54-364d-465f-9bc3-6179502445db service nova] Creating event network-changed:8fa468b7-9788-436b-98a3-9a8ce2151269 for instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b on hv-cinder-85743 Sep 23 14:02:49.942657 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-e977c95e-bda4-4482-80a4-a0e3327438a6 req-ec13ae54-364d-465f-9bc3-6179502445db service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048166 Sep 23 14:02:49.944070 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 46/82] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:02:49.954537 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-bf4dc4d8-56f6-4bc1-b1cb-0f5b3dbd2ca5 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:49.957560 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-bf4dc4d8-56f6-4bc1-b1cb-0f5b3dbd2ca5 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:49.966320 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf4dc4d8-56f6-4bc1-b1cb-0f5b3dbd2ca5 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:49.966982 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf4dc4d8-56f6-4bc1-b1cb-0f5b3dbd2ca5 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:49.967510 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf4dc4d8-56f6-4bc1-b1cb-0f5b3dbd2ca5 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:49.968905 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf4dc4d8-56f6-4bc1-b1cb-0f5b3dbd2ca5 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:49.969686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf4dc4d8-56f6-4bc1-b1cb-0f5b3dbd2ca5 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:49.970236 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf4dc4d8-56f6-4bc1-b1cb-0f5b3dbd2ca5 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:49.977925 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ab522074-e5ef-48b3-8529-bb463ca7459b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:49.985578 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ab522074-e5ef-48b3-8529-bb463ca7459b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1367 microversion: 2.1 time: 0.307929 Sep 23 14:02:49.986134 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 37/83] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:49 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:50.282230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-bf4dc4d8-56f6-4bc1-b1cb-0f5b3dbd2ca5 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:50.290076 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-bf4dc4d8-56f6-4bc1-b1cb-0f5b3dbd2ca5 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.340247 Sep 23 14:02:50.293619 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 47/84] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:49 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:50.374486 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-565a57a1-e57d-4f1c-a8d6-679918b0f1e9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:50.375359 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-565a57a1-e57d-4f1c-a8d6-679918b0f1e9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:50.382748 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-565a57a1-e57d-4f1c-a8d6-679918b0f1e9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:50.383250 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-565a57a1-e57d-4f1c-a8d6-679918b0f1e9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:50.383691 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-565a57a1-e57d-4f1c-a8d6-679918b0f1e9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:50.384392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-565a57a1-e57d-4f1c-a8d6-679918b0f1e9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:50.384848 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-565a57a1-e57d-4f1c-a8d6-679918b0f1e9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:50.385273 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-565a57a1-e57d-4f1c-a8d6-679918b0f1e9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:50.528632 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-565a57a1-e57d-4f1c-a8d6-679918b0f1e9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:50.537601 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-565a57a1-e57d-4f1c-a8d6-679918b0f1e9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.168340 Sep 23 14:02:50.538158 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 38/85] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:50 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:51.014689 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8e3e79b0-41ac-44aa-925e-7a7bd9fbaaa9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:51.015996 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-8e3e79b0-41ac-44aa-925e-7a7bd9fbaaa9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:51.025470 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8e3e79b0-41ac-44aa-925e-7a7bd9fbaaa9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:51.026086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8e3e79b0-41ac-44aa-925e-7a7bd9fbaaa9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:51.026782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8e3e79b0-41ac-44aa-925e-7a7bd9fbaaa9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:51.027550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8e3e79b0-41ac-44aa-925e-7a7bd9fbaaa9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:51.028136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8e3e79b0-41ac-44aa-925e-7a7bd9fbaaa9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:51.028592 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8e3e79b0-41ac-44aa-925e-7a7bd9fbaaa9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:51.318778 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e2ee8d68-0e7b-4114-b028-ca367b5d34e3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:51.319364 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e2ee8d68-0e7b-4114-b028-ca367b5d34e3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:51.326605 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e2ee8d68-0e7b-4114-b028-ca367b5d34e3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:51.327537 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e2ee8d68-0e7b-4114-b028-ca367b5d34e3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:51.328263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e2ee8d68-0e7b-4114-b028-ca367b5d34e3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:51.329356 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e2ee8d68-0e7b-4114-b028-ca367b5d34e3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:51.330268 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e2ee8d68-0e7b-4114-b028-ca367b5d34e3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:51.330860 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e2ee8d68-0e7b-4114-b028-ca367b5d34e3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:51.720150 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-8e3e79b0-41ac-44aa-925e-7a7bd9fbaaa9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:51.732692 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8e3e79b0-41ac-44aa-925e-7a7bd9fbaaa9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1367 microversion: 2.1 time: 0.724511 Sep 23 14:02:51.748921 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 48/86] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:51 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1367 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:51.751976 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-53371fcc-5518-4b9b-88e7-a0e9a6ff4f83 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:51.754533 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-53371fcc-5518-4b9b-88e7-a0e9a6ff4f83 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:51.761718 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-53371fcc-5518-4b9b-88e7-a0e9a6ff4f83 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:51.762216 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-53371fcc-5518-4b9b-88e7-a0e9a6ff4f83 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:51.762814 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-53371fcc-5518-4b9b-88e7-a0e9a6ff4f83 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:51.763597 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-53371fcc-5518-4b9b-88e7-a0e9a6ff4f83 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:51.764076 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-53371fcc-5518-4b9b-88e7-a0e9a6ff4f83 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:51.764898 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-53371fcc-5518-4b9b-88e7-a0e9a6ff4f83 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:51.850946 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e2ee8d68-0e7b-4114-b028-ca367b5d34e3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:51.860335 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e2ee8d68-0e7b-4114-b028-ca367b5d34e3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.547140 Sep 23 14:02:51.861198 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 39/87] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:51 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:02:52.068366 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-53371fcc-5518-4b9b-88e7-a0e9a6ff4f83 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:52.076345 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-53371fcc-5518-4b9b-88e7-a0e9a6ff4f83 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.328784 Sep 23 14:02:52.076921 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 49/88] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:51 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:52.758938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-06a9c884-7fc2-4827-8c97-d89ce43bbeb7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:52.759545 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-06a9c884-7fc2-4827-8c97-d89ce43bbeb7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:52.766431 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06a9c884-7fc2-4827-8c97-d89ce43bbeb7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:52.767193 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06a9c884-7fc2-4827-8c97-d89ce43bbeb7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:52.767641 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06a9c884-7fc2-4827-8c97-d89ce43bbeb7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:52.768423 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06a9c884-7fc2-4827-8c97-d89ce43bbeb7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:52.770288 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06a9c884-7fc2-4827-8c97-d89ce43bbeb7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:52.771082 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06a9c884-7fc2-4827-8c97-d89ce43bbeb7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:52.889298 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5ca17317-8a2c-4a9f-b864-16de03019b7d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:52.889298 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5ca17317-8a2c-4a9f-b864-16de03019b7d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:52.893581 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5ca17317-8a2c-4a9f-b864-16de03019b7d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:52.895333 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5ca17317-8a2c-4a9f-b864-16de03019b7d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:52.895960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5ca17317-8a2c-4a9f-b864-16de03019b7d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:52.897253 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5ca17317-8a2c-4a9f-b864-16de03019b7d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:52.898944 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5ca17317-8a2c-4a9f-b864-16de03019b7d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:52.899557 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5ca17317-8a2c-4a9f-b864-16de03019b7d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:52.933734 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-06a9c884-7fc2-4827-8c97-d89ce43bbeb7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:52.944515 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-06a9c884-7fc2-4827-8c97-d89ce43bbeb7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1367 microversion: 2.1 time: 0.191137 Sep 23 14:02:52.948807 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 40/89] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:52 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:53.102709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-bc9b9ee1-f460-476f-8292-ddf1c23cafea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:53.104126 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-bc9b9ee1-f460-476f-8292-ddf1c23cafea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:53.111213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bc9b9ee1-f460-476f-8292-ddf1c23cafea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:53.111786 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bc9b9ee1-f460-476f-8292-ddf1c23cafea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:53.112232 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bc9b9ee1-f460-476f-8292-ddf1c23cafea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:53.113586 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bc9b9ee1-f460-476f-8292-ddf1c23cafea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:53.114389 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bc9b9ee1-f460-476f-8292-ddf1c23cafea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:53.114828 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bc9b9ee1-f460-476f-8292-ddf1c23cafea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:53.299457 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5ca17317-8a2c-4a9f-b864-16de03019b7d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:53.308982 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5ca17317-8a2c-4a9f-b864-16de03019b7d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.426424 Sep 23 14:02:53.318866 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 50/90] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:52 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:53.359636 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-bc9b9ee1-f460-476f-8292-ddf1c23cafea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:53.373070 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-bc9b9ee1-f460-476f-8292-ddf1c23cafea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.275737 Sep 23 14:02:53.378476 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 41/91] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:53 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:02:53.421327 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:53.471904 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-108c0ebe-036a-441a-a5eb-f89992091e83 req-d4389b4d-58b5-4b35-9133-6f2ffbbaf0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af91809-ccf1-4b46-8778-e073f385d6ef", "name": "network-vif-plugged", "status": "completed", "tag": "2ab6acdc-68c7-4e5c-85c7-bbf6ead5ade9"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:53.480388 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-108c0ebe-036a-441a-a5eb-f89992091e83 req-d4389b4d-58b5-4b35-9133-6f2ffbbaf0e9 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:53.480722 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-108c0ebe-036a-441a-a5eb-f89992091e83 req-d4389b4d-58b5-4b35-9133-6f2ffbbaf0e9 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:53.481151 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-108c0ebe-036a-441a-a5eb-f89992091e83 req-d4389b4d-58b5-4b35-9133-6f2ffbbaf0e9 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:53.493391 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-108c0ebe-036a-441a-a5eb-f89992091e83 req-d4389b4d-58b5-4b35-9133-6f2ffbbaf0e9 service nova] Creating event network-vif-plugged:2ab6acdc-68c7-4e5c-85c7-bbf6ead5ade9 for instance 2af91809-ccf1-4b46-8778-e073f385d6ef on hv-cinder-85743 Sep 23 14:02:53.499769 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-108c0ebe-036a-441a-a5eb-f89992091e83 req-d4389b4d-58b5-4b35-9133-6f2ffbbaf0e9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089609 Sep 23 14:02:53.501544 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 51/92] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:02:53.967700 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-eda2e987-9bde-4b58-8d0c-132fa15bae95 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:53.968310 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-eda2e987-9bde-4b58-8d0c-132fa15bae95 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:53.975031 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-eda2e987-9bde-4b58-8d0c-132fa15bae95 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:53.975440 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-eda2e987-9bde-4b58-8d0c-132fa15bae95 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:53.975880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-eda2e987-9bde-4b58-8d0c-132fa15bae95 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:53.976571 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-eda2e987-9bde-4b58-8d0c-132fa15bae95 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:53.977030 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-eda2e987-9bde-4b58-8d0c-132fa15bae95 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:53.977453 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-eda2e987-9bde-4b58-8d0c-132fa15bae95 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:54.134032 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-eda2e987-9bde-4b58-8d0c-132fa15bae95 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:54.142724 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-eda2e987-9bde-4b58-8d0c-132fa15bae95 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1367 microversion: 2.1 time: 0.178798 Sep 23 14:02:54.143304 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 42/93] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:53 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:54.335603 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-0fdc7bcd-f403-45df-81a2-0f4745b1f76a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:54.336323 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-0fdc7bcd-f403-45df-81a2-0f4745b1f76a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:54.343135 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0fdc7bcd-f403-45df-81a2-0f4745b1f76a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:54.344904 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0fdc7bcd-f403-45df-81a2-0f4745b1f76a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:54.344904 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0fdc7bcd-f403-45df-81a2-0f4745b1f76a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:54.344904 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0fdc7bcd-f403-45df-81a2-0f4745b1f76a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:54.345235 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0fdc7bcd-f403-45df-81a2-0f4745b1f76a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:54.345641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0fdc7bcd-f403-45df-81a2-0f4745b1f76a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:54.397043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-44577328-b45b-49a0-814c-3d8413ee5cbf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:54.397896 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-44577328-b45b-49a0-814c-3d8413ee5cbf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:54.403876 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-44577328-b45b-49a0-814c-3d8413ee5cbf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:54.404370 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-44577328-b45b-49a0-814c-3d8413ee5cbf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:54.404806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-44577328-b45b-49a0-814c-3d8413ee5cbf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:54.405510 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-44577328-b45b-49a0-814c-3d8413ee5cbf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:54.405975 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-44577328-b45b-49a0-814c-3d8413ee5cbf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:54.406499 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-44577328-b45b-49a0-814c-3d8413ee5cbf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:54.533042 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-0fdc7bcd-f403-45df-81a2-0f4745b1f76a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:54.544071 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-0fdc7bcd-f403-45df-81a2-0f4745b1f76a tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.214405 Sep 23 14:02:54.558941 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 52/94] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:54 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:54.604959 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-44577328-b45b-49a0-814c-3d8413ee5cbf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:54.617084 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-44577328-b45b-49a0-814c-3d8413ee5cbf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.224623 Sep 23 14:02:54.622310 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 43/95] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:54 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:02:55.166872 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f1fa61f6-8afc-4f6c-a105-e7faeeb10c6f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:55.167764 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f1fa61f6-8afc-4f6c-a105-e7faeeb10c6f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:55.176373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f1fa61f6-8afc-4f6c-a105-e7faeeb10c6f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:55.177603 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f1fa61f6-8afc-4f6c-a105-e7faeeb10c6f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:55.178288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f1fa61f6-8afc-4f6c-a105-e7faeeb10c6f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:55.179606 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f1fa61f6-8afc-4f6c-a105-e7faeeb10c6f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:55.180290 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f1fa61f6-8afc-4f6c-a105-e7faeeb10c6f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:55.180929 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f1fa61f6-8afc-4f6c-a105-e7faeeb10c6f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:55.391601 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f1fa61f6-8afc-4f6c-a105-e7faeeb10c6f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:55.401332 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f1fa61f6-8afc-4f6c-a105-e7faeeb10c6f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1367 microversion: 2.1 time: 0.238608 Sep 23 14:02:55.402135 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 53/96] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:55 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:55.515537 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-7843de97-9bbb-4862-993c-efb1475cba93 req-31af4768-d665-475e-aa14-1c8a3ec2d98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ff0e5b-c9cf-409f-a993-a5969225c7bf", "name": "network-vif-plugged", "status": "completed", "tag": "08c333a2-80db-4cb2-8c18-245c61e87e9a"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:55.537282 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-7843de97-9bbb-4862-993c-efb1475cba93 req-31af4768-d665-475e-aa14-1c8a3ec2d98c service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:55.537794 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-7843de97-9bbb-4862-993c-efb1475cba93 req-31af4768-d665-475e-aa14-1c8a3ec2d98c service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:55.538239 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-7843de97-9bbb-4862-993c-efb1475cba93 req-31af4768-d665-475e-aa14-1c8a3ec2d98c service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:55.557797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-7843de97-9bbb-4862-993c-efb1475cba93 req-31af4768-d665-475e-aa14-1c8a3ec2d98c service nova] Creating event network-vif-plugged:08c333a2-80db-4cb2-8c18-245c61e87e9a for instance 00ff0e5b-c9cf-409f-a993-a5969225c7bf on hv-cinder-85743 Sep 23 14:02:55.565017 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-7843de97-9bbb-4862-993c-efb1475cba93 req-31af4768-d665-475e-aa14-1c8a3ec2d98c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052894 Sep 23 14:02:55.565661 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 44/97] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:02:55.568697 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a0e24fc5-1070-42a7-94c5-752fc91bf3d3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:55.569301 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a0e24fc5-1070-42a7-94c5-752fc91bf3d3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:55.575290 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0e24fc5-1070-42a7-94c5-752fc91bf3d3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:55.575829 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0e24fc5-1070-42a7-94c5-752fc91bf3d3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:55.576247 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0e24fc5-1070-42a7-94c5-752fc91bf3d3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:55.576924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0e24fc5-1070-42a7-94c5-752fc91bf3d3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:55.577763 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0e24fc5-1070-42a7-94c5-752fc91bf3d3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:55.578383 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0e24fc5-1070-42a7-94c5-752fc91bf3d3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:55.645778 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-2346ca35-c149-496b-bbcd-404db2905fb5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:55.647470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-2346ca35-c149-496b-bbcd-404db2905fb5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:55.653402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2346ca35-c149-496b-bbcd-404db2905fb5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:55.654129 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2346ca35-c149-496b-bbcd-404db2905fb5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:55.654883 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2346ca35-c149-496b-bbcd-404db2905fb5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:55.655582 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2346ca35-c149-496b-bbcd-404db2905fb5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:55.656274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2346ca35-c149-496b-bbcd-404db2905fb5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:55.656980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2346ca35-c149-496b-bbcd-404db2905fb5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:55.762796 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a0e24fc5-1070-42a7-94c5-752fc91bf3d3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:55.776634 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a0e24fc5-1070-42a7-94c5-752fc91bf3d3 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.212041 Sep 23 14:02:55.777294 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 54/98] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:55 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:55.843759 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-2346ca35-c149-496b-bbcd-404db2905fb5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:55.852046 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-2346ca35-c149-496b-bbcd-404db2905fb5 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.211874 Sep 23 14:02:55.852739 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 45/99] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:55 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:56.427315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-94a2b3c2-61d7-436d-bed4-7cab7db4086b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:56.429012 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-94a2b3c2-61d7-436d-bed4-7cab7db4086b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:56.435094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94a2b3c2-61d7-436d-bed4-7cab7db4086b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:56.435578 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94a2b3c2-61d7-436d-bed4-7cab7db4086b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:56.436002 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94a2b3c2-61d7-436d-bed4-7cab7db4086b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:56.436685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94a2b3c2-61d7-436d-bed4-7cab7db4086b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:56.437940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94a2b3c2-61d7-436d-bed4-7cab7db4086b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:56.438389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94a2b3c2-61d7-436d-bed4-7cab7db4086b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:56.443805 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=100 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:56.644281 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-94a2b3c2-61d7-436d-bed4-7cab7db4086b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:56.653018 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-94a2b3c2-61d7-436d-bed4-7cab7db4086b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1367 microversion: 2.1 time: 0.230340 Sep 23 14:02:56.666390 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 55/100] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:56 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:56.804943 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6ad87dc5-b434-4356-9832-2f98b89dd873 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:56.805698 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6ad87dc5-b434-4356-9832-2f98b89dd873 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:56.821562 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6ad87dc5-b434-4356-9832-2f98b89dd873 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:56.823626 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6ad87dc5-b434-4356-9832-2f98b89dd873 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:56.825144 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6ad87dc5-b434-4356-9832-2f98b89dd873 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:56.825897 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6ad87dc5-b434-4356-9832-2f98b89dd873 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:56.826404 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6ad87dc5-b434-4356-9832-2f98b89dd873 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:56.826829 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6ad87dc5-b434-4356-9832-2f98b89dd873 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:56.836282 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=100 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:56.875846 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-7aab45ff-344d-4bfe-8c4c-94565c967d47 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:56.876625 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-7aab45ff-344d-4bfe-8c4c-94565c967d47 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:56.890423 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7aab45ff-344d-4bfe-8c4c-94565c967d47 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:56.892297 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7aab45ff-344d-4bfe-8c4c-94565c967d47 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:56.894603 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7aab45ff-344d-4bfe-8c4c-94565c967d47 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:56.896991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7aab45ff-344d-4bfe-8c4c-94565c967d47 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:56.899575 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7aab45ff-344d-4bfe-8c4c-94565c967d47 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:56.900215 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7aab45ff-344d-4bfe-8c4c-94565c967d47 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:57.153667 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-7aab45ff-344d-4bfe-8c4c-94565c967d47 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:57.164006 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-7aab45ff-344d-4bfe-8c4c-94565c967d47 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.292692 Sep 23 14:02:57.165619 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 56/101] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:56 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:57.172250 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6ad87dc5-b434-4356-9832-2f98b89dd873 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:57.194294 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6ad87dc5-b434-4356-9832-2f98b89dd873 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.395179 Sep 23 14:02:57.195416 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 46/102] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:56 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:57.677871 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ce48e52d-d2f7-473b-b3be-40150d2ce5a2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:57.678542 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ce48e52d-d2f7-473b-b3be-40150d2ce5a2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:57.684567 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ce48e52d-d2f7-473b-b3be-40150d2ce5a2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:57.685049 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ce48e52d-d2f7-473b-b3be-40150d2ce5a2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:57.685493 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ce48e52d-d2f7-473b-b3be-40150d2ce5a2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:57.686179 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ce48e52d-d2f7-473b-b3be-40150d2ce5a2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:57.686663 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ce48e52d-d2f7-473b-b3be-40150d2ce5a2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:57.687082 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ce48e52d-d2f7-473b-b3be-40150d2ce5a2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:57.815876 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-d2fee58d-9449-45ac-8791-2ebdccd0db68 req-6c4e3b95-efad-445a-a99d-b580dd717fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b6d10ec-d6f4-4d14-939c-beab0c9ba13b", "name": "network-vif-plugged", "status": "completed", "tag": "8fa468b7-9788-436b-98a3-9a8ce2151269"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:57.825824 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ce48e52d-d2f7-473b-b3be-40150d2ce5a2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:57.826633 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-d2fee58d-9449-45ac-8791-2ebdccd0db68 req-6c4e3b95-efad-445a-a99d-b580dd717fb4 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:57.827236 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-d2fee58d-9449-45ac-8791-2ebdccd0db68 req-6c4e3b95-efad-445a-a99d-b580dd717fb4 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:57.827530 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-d2fee58d-9449-45ac-8791-2ebdccd0db68 req-6c4e3b95-efad-445a-a99d-b580dd717fb4 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:57.835688 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ce48e52d-d2f7-473b-b3be-40150d2ce5a2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1367 microversion: 2.1 time: 0.160939 Sep 23 14:02:57.835688 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 57/103] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:57 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:57.839253 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-d2fee58d-9449-45ac-8791-2ebdccd0db68 req-6c4e3b95-efad-445a-a99d-b580dd717fb4 service nova] Creating event network-vif-plugged:8fa468b7-9788-436b-98a3-9a8ce2151269 for instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b on hv-cinder-85743 Sep 23 14:02:57.852961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-d2fee58d-9449-45ac-8791-2ebdccd0db68 req-6c4e3b95-efad-445a-a99d-b580dd717fb4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041604 Sep 23 14:02:57.853581 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 47/104] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:02:58.190660 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-7e696949-c29c-4079-9b5e-96d266223f74 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:58.193267 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-7e696949-c29c-4079-9b5e-96d266223f74 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:58.209488 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7e696949-c29c-4079-9b5e-96d266223f74 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:58.479229 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-bf74cd4c-2293-4bff-9945-e4d7a4bb2af1 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:58.479229 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-bf74cd4c-2293-4bff-9945-e4d7a4bb2af1 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:58.481129 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7e696949-c29c-4079-9b5e-96d266223f74 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:58.481129 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7e696949-c29c-4079-9b5e-96d266223f74 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:58.481129 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7e696949-c29c-4079-9b5e-96d266223f74 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:58.481129 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7e696949-c29c-4079-9b5e-96d266223f74 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:58.488115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7e696949-c29c-4079-9b5e-96d266223f74 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:58.491468 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bf74cd4c-2293-4bff-9945-e4d7a4bb2af1 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:58.491468 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bf74cd4c-2293-4bff-9945-e4d7a4bb2af1 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:58.491468 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bf74cd4c-2293-4bff-9945-e4d7a4bb2af1 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:58.491468 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bf74cd4c-2293-4bff-9945-e4d7a4bb2af1 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:58.494237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bf74cd4c-2293-4bff-9945-e4d7a4bb2af1 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:58.494237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bf74cd4c-2293-4bff-9945-e4d7a4bb2af1 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:58.537087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-7e696949-c29c-4079-9b5e-96d266223f74 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:58.537239 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-bf74cd4c-2293-4bff-9945-e4d7a4bb2af1 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:58.545094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-7e696949-c29c-4079-9b5e-96d266223f74 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1322 microversion: 2.1 time: 0.359098 Sep 23 14:02:58.545300 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-bf74cd4c-2293-4bff-9945-e4d7a4bb2af1 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.330490 Sep 23 14:02:58.545767 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 48/105] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:58 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:58.562878 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 58/106] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:58 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:02:58.858301 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ffc56745-8766-42bb-bdc8-774e1e9db5a0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:58.858967 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ffc56745-8766-42bb-bdc8-774e1e9db5a0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:58.865124 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ffc56745-8766-42bb-bdc8-774e1e9db5a0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:58.865612 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ffc56745-8766-42bb-bdc8-774e1e9db5a0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:58.866059 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ffc56745-8766-42bb-bdc8-774e1e9db5a0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:58.866776 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ffc56745-8766-42bb-bdc8-774e1e9db5a0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:58.867233 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ffc56745-8766-42bb-bdc8-774e1e9db5a0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:58.867658 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ffc56745-8766-42bb-bdc8-774e1e9db5a0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:58.999382 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ffc56745-8766-42bb-bdc8-774e1e9db5a0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:59.007336 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ffc56745-8766-42bb-bdc8-774e1e9db5a0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1367 microversion: 2.1 time: 0.152789 Sep 23 14:02:59.008081 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 49/107] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:58 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:59.569703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8f7c1b4d-682d-4b6b-ab75-35d8e05f2eba tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:59.570409 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-8f7c1b4d-682d-4b6b-ab75-35d8e05f2eba tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:59.582105 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f7c1b4d-682d-4b6b-ab75-35d8e05f2eba tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:59.582850 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f7c1b4d-682d-4b6b-ab75-35d8e05f2eba tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:59.583888 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f7c1b4d-682d-4b6b-ab75-35d8e05f2eba tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:59.586392 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f7c1b4d-682d-4b6b-ab75-35d8e05f2eba tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:59.587348 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f7c1b4d-682d-4b6b-ab75-35d8e05f2eba tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:59.588283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f7c1b4d-682d-4b6b-ab75-35d8e05f2eba tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:59.591080 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a6431164-34bf-4740-9c47-08e6f71bad0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:02:59.591736 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a6431164-34bf-4740-9c47-08e6f71bad0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:59.600426 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a6431164-34bf-4740-9c47-08e6f71bad0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:59.602864 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a6431164-34bf-4740-9c47-08e6f71bad0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:59.602864 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a6431164-34bf-4740-9c47-08e6f71bad0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:59.602864 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a6431164-34bf-4740-9c47-08e6f71bad0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:59.602864 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a6431164-34bf-4740-9c47-08e6f71bad0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:59.603223 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a6431164-34bf-4740-9c47-08e6f71bad0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:59.798894 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-8f7c1b4d-682d-4b6b-ab75-35d8e05f2eba tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:59.806939 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a6431164-34bf-4740-9c47-08e6f71bad0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:02:59.809396 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8f7c1b4d-682d-4b6b-ab75-35d8e05f2eba tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.244571 Sep 23 14:02:59.810263 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 59/108] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:59 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:59.815636 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a6431164-34bf-4740-9c47-08e6f71bad0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1516 microversion: 2.1 time: 0.227793 Sep 23 14:02:59.834054 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 50/109] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:02:59 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1516 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:02:59.839733 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d70132bd-6d7e-4730-aa19-cb86cb5def43 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:59.842276 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d70132bd-6d7e-4730-aa19-cb86cb5def43 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:02:59.848786 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d70132bd-6d7e-4730-aa19-cb86cb5def43 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:59.849358 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d70132bd-6d7e-4730-aa19-cb86cb5def43 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:59.849907 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d70132bd-6d7e-4730-aa19-cb86cb5def43 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:59.850825 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d70132bd-6d7e-4730-aa19-cb86cb5def43 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:59.851365 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d70132bd-6d7e-4730-aa19-cb86cb5def43 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:59.851852 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d70132bd-6d7e-4730-aa19-cb86cb5def43 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:59.875637 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-b11dbf79-0a7e-4bd1-a385-0395bc6669a8 req-e9204c16-85d6-4374-a54c-a82a8d1eb885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc990d71-8d2f-4734-a5b2-4401f24cc5b4", "name": "network-vif-plugged", "status": "completed", "tag": "b4188b8d-6da8-4e12-b11f-025e11d549d5"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:02:59.889405 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-b11dbf79-0a7e-4bd1-a385-0395bc6669a8 req-e9204c16-85d6-4374-a54c-a82a8d1eb885 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:02:59.892239 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-b11dbf79-0a7e-4bd1-a385-0395bc6669a8 req-e9204c16-85d6-4374-a54c-a82a8d1eb885 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:02:59.892239 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-b11dbf79-0a7e-4bd1-a385-0395bc6669a8 req-e9204c16-85d6-4374-a54c-a82a8d1eb885 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:02:59.905644 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-b11dbf79-0a7e-4bd1-a385-0395bc6669a8 req-e9204c16-85d6-4374-a54c-a82a8d1eb885 service nova] Creating event network-vif-plugged:b4188b8d-6da8-4e12-b11f-025e11d549d5 for instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 on hv-cinder-85743 Sep 23 14:02:59.912617 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-b11dbf79-0a7e-4bd1-a385-0395bc6669a8 req-e9204c16-85d6-4374-a54c-a82a8d1eb885 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041891 Sep 23 14:02:59.913556 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 51/110] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:02:59.921355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-d70132bd-6d7e-4730-aa19-cb86cb5def43 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lazy-loading 'flavor' on Instance uuid 00ff0e5b-c9cf-409f-a993-a5969225c7bf {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:03:00.032381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-da03089d-ab7c-4673-b8fe-c178acc82fcf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:00.033100 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-da03089d-ab7c-4673-b8fe-c178acc82fcf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:00.043466 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-da03089d-ab7c-4673-b8fe-c178acc82fcf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:00.043466 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-da03089d-ab7c-4673-b8fe-c178acc82fcf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:00.043466 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-da03089d-ab7c-4673-b8fe-c178acc82fcf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:00.043466 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-da03089d-ab7c-4673-b8fe-c178acc82fcf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:00.043849 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-da03089d-ab7c-4673-b8fe-c178acc82fcf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:00.043849 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-da03089d-ab7c-4673-b8fe-c178acc82fcf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:00.287954 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d70132bd-6d7e-4730-aa19-cb86cb5def43 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "POST /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf/action" status: 200 len: 32 microversion: 2.1 time: 0.452378 Sep 23 14:03:00.293178 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 60/111] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 23 14:02:59 2022] POST /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf/action => generated 32 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 14:03:00.301054 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a02e6491-e0b8-4d15-9456-cfdbd94dbb05 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:00.302808 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a02e6491-e0b8-4d15-9456-cfdbd94dbb05 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:00.309865 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a02e6491-e0b8-4d15-9456-cfdbd94dbb05 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:00.310678 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a02e6491-e0b8-4d15-9456-cfdbd94dbb05 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:00.311152 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a02e6491-e0b8-4d15-9456-cfdbd94dbb05 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:00.312263 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a02e6491-e0b8-4d15-9456-cfdbd94dbb05 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:00.313067 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a02e6491-e0b8-4d15-9456-cfdbd94dbb05 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:00.313492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a02e6491-e0b8-4d15-9456-cfdbd94dbb05 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:00.419167 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-da03089d-ab7c-4673-b8fe-c178acc82fcf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:00.439351 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-da03089d-ab7c-4673-b8fe-c178acc82fcf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1367 microversion: 2.1 time: 0.411100 Sep 23 14:03:00.440154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 52/112] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:00 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:03:00.502046 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a02e6491-e0b8-4d15-9456-cfdbd94dbb05 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:00.509860 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a02e6491-e0b8-4d15-9456-cfdbd94dbb05 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.215201 Sep 23 14:03:00.510493 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 61/113] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:00 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:00.833611 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-14510f17-7a98-489b-8351-3dab21e78ea0 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:00.834479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-14510f17-7a98-489b-8351-3dab21e78ea0 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:00.844439 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14510f17-7a98-489b-8351-3dab21e78ea0 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:00.844953 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14510f17-7a98-489b-8351-3dab21e78ea0 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:00.847267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14510f17-7a98-489b-8351-3dab21e78ea0 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:00.848858 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14510f17-7a98-489b-8351-3dab21e78ea0 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:00.849335 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14510f17-7a98-489b-8351-3dab21e78ea0 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:00.852649 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14510f17-7a98-489b-8351-3dab21e78ea0 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:01.045763 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-14510f17-7a98-489b-8351-3dab21e78ea0 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:01.054752 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-14510f17-7a98-489b-8351-3dab21e78ea0 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.225604 Sep 23 14:03:01.055651 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 53/114] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:00 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:01.463280 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-734208f4-f96e-4a81-8f85-6be1d5a11115 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:01.464214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-734208f4-f96e-4a81-8f85-6be1d5a11115 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:01.484780 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-734208f4-f96e-4a81-8f85-6be1d5a11115 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:01.485571 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-734208f4-f96e-4a81-8f85-6be1d5a11115 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:01.487217 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-734208f4-f96e-4a81-8f85-6be1d5a11115 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:01.491847 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-734208f4-f96e-4a81-8f85-6be1d5a11115 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:01.492320 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-734208f4-f96e-4a81-8f85-6be1d5a11115 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:01.492818 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-734208f4-f96e-4a81-8f85-6be1d5a11115 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:01.533497 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-2d02c981-3d9f-4b9e-a7ba-3fd3c776f6c9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:01.534119 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-2d02c981-3d9f-4b9e-a7ba-3fd3c776f6c9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:01.542357 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2d02c981-3d9f-4b9e-a7ba-3fd3c776f6c9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:01.544649 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2d02c981-3d9f-4b9e-a7ba-3fd3c776f6c9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:01.544917 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2d02c981-3d9f-4b9e-a7ba-3fd3c776f6c9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:01.545634 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2d02c981-3d9f-4b9e-a7ba-3fd3c776f6c9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:01.546098 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2d02c981-3d9f-4b9e-a7ba-3fd3c776f6c9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:01.550322 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2d02c981-3d9f-4b9e-a7ba-3fd3c776f6c9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:01.789582 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-2d02c981-3d9f-4b9e-a7ba-3fd3c776f6c9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:01.798273 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-2d02c981-3d9f-4b9e-a7ba-3fd3c776f6c9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.269271 Sep 23 14:03:01.799008 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 54/115] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:01 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:03:01.800179 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-734208f4-f96e-4a81-8f85-6be1d5a11115 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:01.813518 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-734208f4-f96e-4a81-8f85-6be1d5a11115 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1558 microversion: 2.1 time: 0.353725 Sep 23 14:03:01.815757 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 62/116] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:01 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1558 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:01.839383 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8e8f9caf-a26c-4908-a2be-2da2efda3db7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:01.840224 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8e8f9caf-a26c-4908-a2be-2da2efda3db7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:01.847520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e8f9caf-a26c-4908-a2be-2da2efda3db7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:01.848007 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e8f9caf-a26c-4908-a2be-2da2efda3db7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:01.855328 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e8f9caf-a26c-4908-a2be-2da2efda3db7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:01.855328 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e8f9caf-a26c-4908-a2be-2da2efda3db7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:01.855328 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e8f9caf-a26c-4908-a2be-2da2efda3db7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:01.855328 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e8f9caf-a26c-4908-a2be-2da2efda3db7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:01.993618 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8e8f9caf-a26c-4908-a2be-2da2efda3db7 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.158422 Sep 23 14:03:01.994210 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 55/117] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 23 14:03:01 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:03:02.078978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-87094b76-c713-4bf8-83c8-e9fecdcfe31c tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:02.079611 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-87094b76-c713-4bf8-83c8-e9fecdcfe31c tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:02.092958 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-87094b76-c713-4bf8-83c8-e9fecdcfe31c tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:02.092958 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-87094b76-c713-4bf8-83c8-e9fecdcfe31c tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:02.092958 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-87094b76-c713-4bf8-83c8-e9fecdcfe31c tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:02.093509 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-87094b76-c713-4bf8-83c8-e9fecdcfe31c tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:02.094147 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-87094b76-c713-4bf8-83c8-e9fecdcfe31c tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:02.103512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-87094b76-c713-4bf8-83c8-e9fecdcfe31c tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:02.404134 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-87094b76-c713-4bf8-83c8-e9fecdcfe31c tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:02.413557 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-87094b76-c713-4bf8-83c8-e9fecdcfe31c tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1314 microversion: 2.1 time: 0.338615 Sep 23 14:03:02.416338 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 63/118] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:02 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:02.831399 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b279866e-bbf3-4e44-9579-9a4f554530ba tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:02.832165 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b279866e-bbf3-4e44-9579-9a4f554530ba tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:02.841378 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b279866e-bbf3-4e44-9579-9a4f554530ba tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:02.842444 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b279866e-bbf3-4e44-9579-9a4f554530ba tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:02.842444 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b279866e-bbf3-4e44-9579-9a4f554530ba tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:02.845253 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b279866e-bbf3-4e44-9579-9a4f554530ba tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:02.845764 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b279866e-bbf3-4e44-9579-9a4f554530ba tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:02.846240 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b279866e-bbf3-4e44-9579-9a4f554530ba tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:03.079829 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b279866e-bbf3-4e44-9579-9a4f554530ba tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:03.087759 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b279866e-bbf3-4e44-9579-9a4f554530ba tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.264629 Sep 23 14:03:03.088330 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 56/119] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:02 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:03.438839 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-bf0f999e-3b72-498f-a043-9aa43c982ce7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:03.439450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-bf0f999e-3b72-498f-a043-9aa43c982ce7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:03.447508 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf0f999e-3b72-498f-a043-9aa43c982ce7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:03.448012 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf0f999e-3b72-498f-a043-9aa43c982ce7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:03.448464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf0f999e-3b72-498f-a043-9aa43c982ce7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:03.449179 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf0f999e-3b72-498f-a043-9aa43c982ce7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:03.449636 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf0f999e-3b72-498f-a043-9aa43c982ce7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:03.450057 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf0f999e-3b72-498f-a043-9aa43c982ce7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:03.694940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-bf0f999e-3b72-498f-a043-9aa43c982ce7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:03.702737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-bf0f999e-3b72-498f-a043-9aa43c982ce7 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1500 microversion: 2.1 time: 0.267781 Sep 23 14:03:03.703277 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 64/120] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:03 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1500 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:03.937016 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-a2c47e9f-0c4d-4acd-b85a-3d8b64a2f1dd req-6ae95684-8ad1-4387-a0dd-06da722a8527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b6d10ec-d6f4-4d14-939c-beab0c9ba13b", "tag": "8fa468b7-9788-436b-98a3-9a8ce2151269"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:03:03.947162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-a2c47e9f-0c4d-4acd-b85a-3d8b64a2f1dd req-6ae95684-8ad1-4387-a0dd-06da722a8527 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:03.947672 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-a2c47e9f-0c4d-4acd-b85a-3d8b64a2f1dd req-6ae95684-8ad1-4387-a0dd-06da722a8527 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:03.949752 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-a2c47e9f-0c4d-4acd-b85a-3d8b64a2f1dd req-6ae95684-8ad1-4387-a0dd-06da722a8527 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:03.959516 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-a2c47e9f-0c4d-4acd-b85a-3d8b64a2f1dd req-6ae95684-8ad1-4387-a0dd-06da722a8527 service nova] Creating event network-changed:8fa468b7-9788-436b-98a3-9a8ce2151269 for instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b on hv-cinder-85743 Sep 23 14:03:03.964780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-a2c47e9f-0c4d-4acd-b85a-3d8b64a2f1dd req-6ae95684-8ad1-4387-a0dd-06da722a8527 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031305 Sep 23 14:03:03.967158 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 57/121] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:03:04.121393 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9ddc633d-3fd8-43f8-a13b-164b8764cd23 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:04.121393 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9ddc633d-3fd8-43f8-a13b-164b8764cd23 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:04.136323 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9ddc633d-3fd8-43f8-a13b-164b8764cd23 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:04.144380 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9ddc633d-3fd8-43f8-a13b-164b8764cd23 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:04.144380 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9ddc633d-3fd8-43f8-a13b-164b8764cd23 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:04.144380 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9ddc633d-3fd8-43f8-a13b-164b8764cd23 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:04.148684 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9ddc633d-3fd8-43f8-a13b-164b8764cd23 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:04.151086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9ddc633d-3fd8-43f8-a13b-164b8764cd23 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:04.474062 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9ddc633d-3fd8-43f8-a13b-164b8764cd23 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:04.483290 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9ddc633d-3fd8-43f8-a13b-164b8764cd23 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.369051 Sep 23 14:03:04.485799 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 65/122] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:04 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:05.511690 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5f3d40c5-2815-44e5-94e3-278f204925e6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:05.512385 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-5f3d40c5-2815-44e5-94e3-278f204925e6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:05.520958 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5f3d40c5-2815-44e5-94e3-278f204925e6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:05.521442 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5f3d40c5-2815-44e5-94e3-278f204925e6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:05.522036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5f3d40c5-2815-44e5-94e3-278f204925e6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:05.522784 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5f3d40c5-2815-44e5-94e3-278f204925e6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:05.523379 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5f3d40c5-2815-44e5-94e3-278f204925e6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:05.523858 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5f3d40c5-2815-44e5-94e3-278f204925e6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:05.721640 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5f3d40c5-2815-44e5-94e3-278f204925e6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:05.729741 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5f3d40c5-2815-44e5-94e3-278f204925e6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.222619 Sep 23 14:03:05.731555 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 58/123] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:05 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:05.751642 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ac8552d2-789c-4b74-8ca5-cfbff997a74d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c71bf497-db9d-4dc7-b01e-99ddc1c31c46"}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:03:05.754775 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ac8552d2-789c-4b74-8ca5-cfbff997a74d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:05.762369 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ac8552d2-789c-4b74-8ca5-cfbff997a74d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:05.765983 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ac8552d2-789c-4b74-8ca5-cfbff997a74d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:05.765983 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ac8552d2-789c-4b74-8ca5-cfbff997a74d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:05.765983 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ac8552d2-789c-4b74-8ca5-cfbff997a74d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:05.765983 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ac8552d2-789c-4b74-8ca5-cfbff997a74d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:05.766267 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ac8552d2-789c-4b74-8ca5-cfbff997a74d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:06.757153 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-3f5fb5e8-e6af-4d20-aa3c-8bb748056e14 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:06.757780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-3f5fb5e8-e6af-4d20-aa3c-8bb748056e14 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:06.765477 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f5fb5e8-e6af-4d20-aa3c-8bb748056e14 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:06.765974 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f5fb5e8-e6af-4d20-aa3c-8bb748056e14 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:06.766435 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f5fb5e8-e6af-4d20-aa3c-8bb748056e14 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:06.767422 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f5fb5e8-e6af-4d20-aa3c-8bb748056e14 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:06.768316 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f5fb5e8-e6af-4d20-aa3c-8bb748056e14 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:06.768878 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f5fb5e8-e6af-4d20-aa3c-8bb748056e14 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:06.806591 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ac8552d2-789c-4b74-8ca5-cfbff997a74d tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "POST /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.062353 Sep 23 14:03:06.807766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 66/124] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 23 14:03:05 2022] POST /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4/os-volume_attachments => generated 194 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:03:06.944986 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-3f5fb5e8-e6af-4d20-aa3c-8bb748056e14 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:06.959732 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-3f5fb5e8-e6af-4d20-aa3c-8bb748056e14 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.206368 Sep 23 14:03:06.963754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 59/125] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:06 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:03:07.992399 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-38961865-8cd6-4b91-8c4b-07bc2acf8cd0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:07.993094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-38961865-8cd6-4b91-8c4b-07bc2acf8cd0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:07.999246 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-38961865-8cd6-4b91-8c4b-07bc2acf8cd0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:07.999721 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-38961865-8cd6-4b91-8c4b-07bc2acf8cd0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:08.000153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-38961865-8cd6-4b91-8c4b-07bc2acf8cd0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:08.000826 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-38961865-8cd6-4b91-8c4b-07bc2acf8cd0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:08.001275 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-38961865-8cd6-4b91-8c4b-07bc2acf8cd0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:08.001725 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-38961865-8cd6-4b91-8c4b-07bc2acf8cd0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:08.134560 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-38961865-8cd6-4b91-8c4b-07bc2acf8cd0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:08.143411 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-38961865-8cd6-4b91-8c4b-07bc2acf8cd0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.155570 Sep 23 14:03:08.143871 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 67/126] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:07 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:09.167113 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0265ff2e-90f8-4ed2-b5bf-1e98bffce367 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:09.167726 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-0265ff2e-90f8-4ed2-b5bf-1e98bffce367 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:09.169692 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=76 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:09.176429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0265ff2e-90f8-4ed2-b5bf-1e98bffce367 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:09.176429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0265ff2e-90f8-4ed2-b5bf-1e98bffce367 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:09.176712 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0265ff2e-90f8-4ed2-b5bf-1e98bffce367 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:09.177417 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0265ff2e-90f8-4ed2-b5bf-1e98bffce367 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:09.177872 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0265ff2e-90f8-4ed2-b5bf-1e98bffce367 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:09.178297 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0265ff2e-90f8-4ed2-b5bf-1e98bffce367 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:09.330891 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-0265ff2e-90f8-4ed2-b5bf-1e98bffce367 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:09.339060 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-0265ff2e-90f8-4ed2-b5bf-1e98bffce367 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.175957 Sep 23 14:03:09.339772 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 60/127] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:09 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:10.363138 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ced0cb18-324f-4c2f-bd0d-63609f61f44e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:10.363836 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ced0cb18-324f-4c2f-bd0d-63609f61f44e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:10.370185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ced0cb18-324f-4c2f-bd0d-63609f61f44e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:10.370772 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ced0cb18-324f-4c2f-bd0d-63609f61f44e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:10.371206 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ced0cb18-324f-4c2f-bd0d-63609f61f44e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:10.371893 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ced0cb18-324f-4c2f-bd0d-63609f61f44e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:10.372348 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ced0cb18-324f-4c2f-bd0d-63609f61f44e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:10.372771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ced0cb18-324f-4c2f-bd0d-63609f61f44e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:10.390400 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:10.515952 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ced0cb18-324f-4c2f-bd0d-63609f61f44e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:10.524832 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ced0cb18-324f-4c2f-bd0d-63609f61f44e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.165716 Sep 23 14:03:10.525596 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 68/128] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:10 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:11.549596 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-926a8e52-ade8-4874-aadc-22815e60d4a6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:11.550759 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-926a8e52-ade8-4874-aadc-22815e60d4a6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:11.560668 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-926a8e52-ade8-4874-aadc-22815e60d4a6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:11.560668 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-926a8e52-ade8-4874-aadc-22815e60d4a6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:11.560668 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-926a8e52-ade8-4874-aadc-22815e60d4a6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:11.560668 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-926a8e52-ade8-4874-aadc-22815e60d4a6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:11.561996 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-926a8e52-ade8-4874-aadc-22815e60d4a6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:11.561996 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-926a8e52-ade8-4874-aadc-22815e60d4a6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:11.809675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-926a8e52-ade8-4874-aadc-22815e60d4a6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:11.818551 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-926a8e52-ade8-4874-aadc-22815e60d4a6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.273324 Sep 23 14:03:11.819138 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 61/129] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:11 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:12.842719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-342f0320-beee-4a46-8f9e-806e30a6328e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:12.844504 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-342f0320-beee-4a46-8f9e-806e30a6328e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:12.853875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-342f0320-beee-4a46-8f9e-806e30a6328e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:12.854623 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-342f0320-beee-4a46-8f9e-806e30a6328e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:12.855293 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-342f0320-beee-4a46-8f9e-806e30a6328e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:12.856197 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-342f0320-beee-4a46-8f9e-806e30a6328e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:12.856810 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-342f0320-beee-4a46-8f9e-806e30a6328e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:12.857230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-342f0320-beee-4a46-8f9e-806e30a6328e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:13.010988 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-342f0320-beee-4a46-8f9e-806e30a6328e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:13.019717 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-342f0320-beee-4a46-8f9e-806e30a6328e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.182626 Sep 23 14:03:13.020402 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 69/130] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:12 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:14.042982 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e9e03628-614e-4450-94ba-a514f505da1d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:14.043714 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e9e03628-614e-4450-94ba-a514f505da1d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:14.055373 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e9e03628-614e-4450-94ba-a514f505da1d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:14.055967 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e9e03628-614e-4450-94ba-a514f505da1d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:14.056620 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e9e03628-614e-4450-94ba-a514f505da1d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:14.062846 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e9e03628-614e-4450-94ba-a514f505da1d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:14.062846 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e9e03628-614e-4450-94ba-a514f505da1d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:14.062846 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e9e03628-614e-4450-94ba-a514f505da1d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:14.226437 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e9e03628-614e-4450-94ba-a514f505da1d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:14.235414 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e9e03628-614e-4450-94ba-a514f505da1d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.196528 Sep 23 14:03:14.236882 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 62/131] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:14 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:15.259663 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-984df514-190f-4c16-b268-465c9401cdc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:15.260297 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-984df514-190f-4c16-b268-465c9401cdc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:15.267942 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-984df514-190f-4c16-b268-465c9401cdc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:15.268426 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-984df514-190f-4c16-b268-465c9401cdc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:15.268861 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-984df514-190f-4c16-b268-465c9401cdc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:15.269541 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-984df514-190f-4c16-b268-465c9401cdc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:15.269994 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-984df514-190f-4c16-b268-465c9401cdc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:15.270446 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-984df514-190f-4c16-b268-465c9401cdc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:15.442113 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-984df514-190f-4c16-b268-465c9401cdc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:15.450159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-984df514-190f-4c16-b268-465c9401cdc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.194373 Sep 23 14:03:15.450758 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 70/132] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:15 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:16.477781 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5334cc2b-9537-40f7-be47-c64ccbe0bafb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:16.478410 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-5334cc2b-9537-40f7-be47-c64ccbe0bafb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:16.486015 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5334cc2b-9537-40f7-be47-c64ccbe0bafb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:16.487002 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5334cc2b-9537-40f7-be47-c64ccbe0bafb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:16.487681 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5334cc2b-9537-40f7-be47-c64ccbe0bafb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:16.488664 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5334cc2b-9537-40f7-be47-c64ccbe0bafb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:16.489265 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5334cc2b-9537-40f7-be47-c64ccbe0bafb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:16.490035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5334cc2b-9537-40f7-be47-c64ccbe0bafb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:16.651733 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5334cc2b-9537-40f7-be47-c64ccbe0bafb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:16.660988 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5334cc2b-9537-40f7-be47-c64ccbe0bafb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.187784 Sep 23 14:03:16.661653 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 63/133] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:16 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:17.685203 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-65892b76-6d27-4ddd-98af-01c7b71ce127 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:17.685955 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-65892b76-6d27-4ddd-98af-01c7b71ce127 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:17.693333 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-65892b76-6d27-4ddd-98af-01c7b71ce127 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:17.693940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-65892b76-6d27-4ddd-98af-01c7b71ce127 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:17.694640 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-65892b76-6d27-4ddd-98af-01c7b71ce127 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:17.695608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-65892b76-6d27-4ddd-98af-01c7b71ce127 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:17.696253 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-65892b76-6d27-4ddd-98af-01c7b71ce127 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:17.697166 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-65892b76-6d27-4ddd-98af-01c7b71ce127 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:17.897431 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-65892b76-6d27-4ddd-98af-01c7b71ce127 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:17.910117 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-65892b76-6d27-4ddd-98af-01c7b71ce127 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.226158 Sep 23 14:03:17.910117 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 71/134] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:17 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:18.933376 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4189006c-e3b6-44db-9f19-0eae3f9f5510 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:18.934663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4189006c-e3b6-44db-9f19-0eae3f9f5510 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:18.941197 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4189006c-e3b6-44db-9f19-0eae3f9f5510 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:18.941992 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4189006c-e3b6-44db-9f19-0eae3f9f5510 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:18.942467 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4189006c-e3b6-44db-9f19-0eae3f9f5510 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:18.943248 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4189006c-e3b6-44db-9f19-0eae3f9f5510 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:18.943854 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4189006c-e3b6-44db-9f19-0eae3f9f5510 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:18.944504 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4189006c-e3b6-44db-9f19-0eae3f9f5510 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:19.116850 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4189006c-e3b6-44db-9f19-0eae3f9f5510 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:19.130428 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4189006c-e3b6-44db-9f19-0eae3f9f5510 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.201918 Sep 23 14:03:19.139929 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 64/135] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:18 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:19.356721 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-da81f73e-4f4c-483b-b065-3784989d1efc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:19.356721 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-da81f73e-4f4c-483b-b065-3784989d1efc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:19.366074 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-da81f73e-4f4c-483b-b065-3784989d1efc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:19.366608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-da81f73e-4f4c-483b-b065-3784989d1efc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:19.367048 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-da81f73e-4f4c-483b-b065-3784989d1efc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:19.367743 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-da81f73e-4f4c-483b-b065-3784989d1efc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:19.368190 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-da81f73e-4f4c-483b-b065-3784989d1efc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:19.368876 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-da81f73e-4f4c-483b-b065-3784989d1efc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:19.396011 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-da81f73e-4f4c-483b-b065-3784989d1efc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Going to try to terminate instance {{(pid=121073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:03:19.741516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-da81f73e-4f4c-483b-b065-3784989d1efc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 204 len: 0 microversion: 2.1 time: 0.386678 Sep 23 14:03:19.743376 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 72/136] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:03:19 2022] DELETE /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:03:19.751554 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9af5dda4-cdc9-45c5-9990-f8f3949b6edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:19.752162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-9af5dda4-cdc9-45c5-9990-f8f3949b6edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:19.768263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9af5dda4-cdc9-45c5-9990-f8f3949b6edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:19.768978 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9af5dda4-cdc9-45c5-9990-f8f3949b6edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:19.769589 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9af5dda4-cdc9-45c5-9990-f8f3949b6edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:19.770348 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9af5dda4-cdc9-45c5-9990-f8f3949b6edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:19.771020 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9af5dda4-cdc9-45c5-9990-f8f3949b6edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:19.771645 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9af5dda4-cdc9-45c5-9990-f8f3949b6edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:19.777418 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=100 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:19.992977 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9af5dda4-cdc9-45c5-9990-f8f3949b6edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:20.001986 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-9af5dda4-cdc9-45c5-9990-f8f3949b6edd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1552 microversion: 2.1 time: 0.254302 Sep 23 14:03:20.002971 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 65/137] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:19 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1552 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:20.157181 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-265a3484-6b2e-4ecc-9968-1ac7e9b3c011 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:20.165108 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-265a3484-6b2e-4ecc-9968-1ac7e9b3c011 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:20.165496 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-265a3484-6b2e-4ecc-9968-1ac7e9b3c011 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:20.166172 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-265a3484-6b2e-4ecc-9968-1ac7e9b3c011 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:20.166805 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-265a3484-6b2e-4ecc-9968-1ac7e9b3c011 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:20.167689 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-265a3484-6b2e-4ecc-9968-1ac7e9b3c011 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:20.168293 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-265a3484-6b2e-4ecc-9968-1ac7e9b3c011 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:20.168860 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-265a3484-6b2e-4ecc-9968-1ac7e9b3c011 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:20.418856 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-265a3484-6b2e-4ecc-9968-1ac7e9b3c011 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:20.424259 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-265a3484-6b2e-4ecc-9968-1ac7e9b3c011 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.271979 Sep 23 14:03:20.441513 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 73/138] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:20 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:21.025517 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-25979269-10fc-469c-91b1-9833f83bcbcd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:21.028214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-25979269-10fc-469c-91b1-9833f83bcbcd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:21.043633 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25979269-10fc-469c-91b1-9833f83bcbcd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:21.044664 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25979269-10fc-469c-91b1-9833f83bcbcd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:21.045118 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25979269-10fc-469c-91b1-9833f83bcbcd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:21.046156 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25979269-10fc-469c-91b1-9833f83bcbcd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:21.046666 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25979269-10fc-469c-91b1-9833f83bcbcd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:21.047777 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25979269-10fc-469c-91b1-9833f83bcbcd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:21.311272 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-25979269-10fc-469c-91b1-9833f83bcbcd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:21.326168 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-25979269-10fc-469c-91b1-9833f83bcbcd tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1552 microversion: 2.1 time: 0.303272 Sep 23 14:03:21.338358 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 66/139] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:21 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1552 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:21.450650 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-420264a8-2cab-4f2c-a57a-95e4fba9b0f0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:21.451888 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-420264a8-2cab-4f2c-a57a-95e4fba9b0f0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:21.455911 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:21.459293 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-420264a8-2cab-4f2c-a57a-95e4fba9b0f0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:21.460034 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-420264a8-2cab-4f2c-a57a-95e4fba9b0f0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:21.460467 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-420264a8-2cab-4f2c-a57a-95e4fba9b0f0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:21.461164 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-420264a8-2cab-4f2c-a57a-95e4fba9b0f0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:21.461614 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-420264a8-2cab-4f2c-a57a-95e4fba9b0f0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:21.462038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-420264a8-2cab-4f2c-a57a-95e4fba9b0f0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:21.731859 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-420264a8-2cab-4f2c-a57a-95e4fba9b0f0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:21.742232 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-420264a8-2cab-4f2c-a57a-95e4fba9b0f0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.295305 Sep 23 14:03:21.742866 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 74/140] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:21 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:22.356534 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-56725946-6a81-4631-a64c-304eb4fd3008 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:22.358388 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-56725946-6a81-4631-a64c-304eb4fd3008 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:22.376761 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-56725946-6a81-4631-a64c-304eb4fd3008 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:22.378107 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-56725946-6a81-4631-a64c-304eb4fd3008 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:22.378795 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-56725946-6a81-4631-a64c-304eb4fd3008 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:22.381578 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-56725946-6a81-4631-a64c-304eb4fd3008 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:22.382075 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-56725946-6a81-4631-a64c-304eb4fd3008 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:22.382532 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-56725946-6a81-4631-a64c-304eb4fd3008 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:22.615820 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-56725946-6a81-4631-a64c-304eb4fd3008 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:22.630642 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-56725946-6a81-4631-a64c-304eb4fd3008 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1552 microversion: 2.1 time: 0.283714 Sep 23 14:03:22.636810 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 67/141] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:22 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1552 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:22.768386 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6ce15123-6e03-499e-aa8c-f265e0cbc2d0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:22.769457 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-6ce15123-6e03-499e-aa8c-f265e0cbc2d0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:22.804670 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6ce15123-6e03-499e-aa8c-f265e0cbc2d0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:22.811782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6ce15123-6e03-499e-aa8c-f265e0cbc2d0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:22.812412 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6ce15123-6e03-499e-aa8c-f265e0cbc2d0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:22.816844 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6ce15123-6e03-499e-aa8c-f265e0cbc2d0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:22.818398 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6ce15123-6e03-499e-aa8c-f265e0cbc2d0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:22.823627 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6ce15123-6e03-499e-aa8c-f265e0cbc2d0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:23.122044 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-6ce15123-6e03-499e-aa8c-f265e0cbc2d0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:23.134169 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-6ce15123-6e03-499e-aa8c-f265e0cbc2d0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.372909 Sep 23 14:03:23.135885 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 75/142] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:22 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:23.258143 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-6c45fbe3-ef4b-4380-8b28-cf374f0f01af req-c5688924-3c00-4d87-9242-42d9576296a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc990d71-8d2f-4734-a5b2-4401f24cc5b4", "name": "network-vif-deleted", "tag": "b4188b8d-6da8-4e12-b11f-025e11d549d5"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:03:23.275170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-6c45fbe3-ef4b-4380-8b28-cf374f0f01af req-c5688924-3c00-4d87-9242-42d9576296a5 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:23.283700 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-6c45fbe3-ef4b-4380-8b28-cf374f0f01af req-c5688924-3c00-4d87-9242-42d9576296a5 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:23.283700 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-6c45fbe3-ef4b-4380-8b28-cf374f0f01af req-c5688924-3c00-4d87-9242-42d9576296a5 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:23.294308 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-6c45fbe3-ef4b-4380-8b28-cf374f0f01af req-c5688924-3c00-4d87-9242-42d9576296a5 service nova] Creating event network-vif-deleted:b4188b8d-6da8-4e12-b11f-025e11d549d5 for instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 on hv-cinder-85743 Sep 23 14:03:23.303062 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-6c45fbe3-ef4b-4380-8b28-cf374f0f01af req-c5688924-3c00-4d87-9242-42d9576296a5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050229 Sep 23 14:03:23.307716 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 68/143] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:03:23.661824 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9d524b2f-6c9b-47d3-8e5a-0312bd9a79dc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:23.662801 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9d524b2f-6c9b-47d3-8e5a-0312bd9a79dc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:23.677876 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d524b2f-6c9b-47d3-8e5a-0312bd9a79dc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:23.679073 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d524b2f-6c9b-47d3-8e5a-0312bd9a79dc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:23.679952 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d524b2f-6c9b-47d3-8e5a-0312bd9a79dc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:23.680904 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d524b2f-6c9b-47d3-8e5a-0312bd9a79dc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:23.681378 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d524b2f-6c9b-47d3-8e5a-0312bd9a79dc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:23.681812 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d524b2f-6c9b-47d3-8e5a-0312bd9a79dc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:23.827512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9d524b2f-6c9b-47d3-8e5a-0312bd9a79dc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:23.857929 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9d524b2f-6c9b-47d3-8e5a-0312bd9a79dc tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1345 microversion: 2.1 time: 0.199662 Sep 23 14:03:23.860654 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 76/144] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:23 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1345 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:24.159492 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d50b0db7-0cf9-4814-986c-4ea659af9ef0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:24.161071 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d50b0db7-0cf9-4814-986c-4ea659af9ef0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:24.172779 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d50b0db7-0cf9-4814-986c-4ea659af9ef0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:24.173283 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d50b0db7-0cf9-4814-986c-4ea659af9ef0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:24.173751 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d50b0db7-0cf9-4814-986c-4ea659af9ef0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:24.179241 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d50b0db7-0cf9-4814-986c-4ea659af9ef0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:24.182030 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d50b0db7-0cf9-4814-986c-4ea659af9ef0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:24.182581 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d50b0db7-0cf9-4814-986c-4ea659af9ef0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:24.525770 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d50b0db7-0cf9-4814-986c-4ea659af9ef0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:24.537610 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d50b0db7-0cf9-4814-986c-4ea659af9ef0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.384059 Sep 23 14:03:24.543118 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 69/145] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:24 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:24.891988 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-14ba581d-f587-4c7e-a7d4-8bd39a0835db tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:24.892707 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-14ba581d-f587-4c7e-a7d4-8bd39a0835db tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:24.899939 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-14ba581d-f587-4c7e-a7d4-8bd39a0835db tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:24.900856 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-14ba581d-f587-4c7e-a7d4-8bd39a0835db tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:24.901467 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-14ba581d-f587-4c7e-a7d4-8bd39a0835db tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:24.902361 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-14ba581d-f587-4c7e-a7d4-8bd39a0835db tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:24.902994 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-14ba581d-f587-4c7e-a7d4-8bd39a0835db tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:24.903612 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-14ba581d-f587-4c7e-a7d4-8bd39a0835db tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:24.943881 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-14ba581d-f587-4c7e-a7d4-8bd39a0835db tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:24.944696 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-14ba581d-f587-4c7e-a7d4-8bd39a0835db tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:24.945571 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-14ba581d-f587-4c7e-a7d4-8bd39a0835db tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:24.946231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-14ba581d-f587-4c7e-a7d4-8bd39a0835db tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lazy-loading 'fault' on Instance uuid fc990d71-8d2f-4734-a5b2-4401f24cc5b4 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:03:25.004059 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-14ba581d-f587-4c7e-a7d4-8bd39a0835db tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8db8d7d494c62b65e427278ef9a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1a67a82fb44cf59f9b4f30848881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:25.022942 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-14ba581d-f587-4c7e-a7d4-8bd39a0835db tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 200 len: 1350 microversion: 2.1 time: 0.132285 Sep 23 14:03:25.023157 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 77/146] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:24 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:25.567974 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-c4d3d7d1-38a0-410e-b911-992a3d3b510d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:25.569885 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-c4d3d7d1-38a0-410e-b911-992a3d3b510d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:25.587606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c4d3d7d1-38a0-410e-b911-992a3d3b510d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:25.592544 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c4d3d7d1-38a0-410e-b911-992a3d3b510d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:25.595082 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c4d3d7d1-38a0-410e-b911-992a3d3b510d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:25.599092 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c4d3d7d1-38a0-410e-b911-992a3d3b510d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:25.599607 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c4d3d7d1-38a0-410e-b911-992a3d3b510d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:25.600062 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c4d3d7d1-38a0-410e-b911-992a3d3b510d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:25.888202 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-c4d3d7d1-38a0-410e-b911-992a3d3b510d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:25.898767 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-c4d3d7d1-38a0-410e-b911-992a3d3b510d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.336066 Sep 23 14:03:25.899492 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 70/147] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:25 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:26.046854 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b372215e-56b0-4578-9844-7ff707d16e33 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:26.047554 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b372215e-56b0-4578-9844-7ff707d16e33 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:26.054175 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b372215e-56b0-4578-9844-7ff707d16e33 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:26.060435 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b372215e-56b0-4578-9844-7ff707d16e33 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:26.060435 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b372215e-56b0-4578-9844-7ff707d16e33 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:26.060435 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b372215e-56b0-4578-9844-7ff707d16e33 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:26.060435 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b372215e-56b0-4578-9844-7ff707d16e33 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:26.061017 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b372215e-56b0-4578-9844-7ff707d16e33 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:26.071957 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-b372215e-56b0-4578-9844-7ff707d16e33 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] HTTP exception thrown: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b372215e-56b0-4578-9844-7ff707d16e33 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Request method failure captured: Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 HTTP/1.1 Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbxsS7O0BYUBz8BmxUfYWDHzvXsZcJuBms38wT1lOBQUMR9bdYrIrH0sXlxCpciOjloT8i54bHauZXt7JmdvBJfyzkAbXc1-HvT-U9YAXTxfT1y1ER-5J9793sz0twr-zmEMD_k0al2CZnO2Dpr_ATXq87Kso1ACjRtfee8lrAiX5jc Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 8e1a67a82fb44cf59f9b4f30848881d1 Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-DeleteServersTestJSON-836308439 Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:03:26.077050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:03:26.079251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e1a67a82fb44cf59f9b4f30848881d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e1a67a82fb44cf59f9b4f30848881d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8e1a67a82fb44cf59f9b4f30848881d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8e1a67a82fb44cf59f9b4f30848881d1"}]}] Sep 23 14:03:26.079251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-DeleteServersTestJSON-836308439 Sep 23 14:03:26.079251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 8e1a67a82fb44cf59f9b4f30848881d1 Sep 23 14:03:26.079251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-DeleteServersTestJSON-836308439 Sep 23 14:03:26.079251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-DeleteServersTestJSON-836308439-project Sep 23 14:03:26.079251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:03:26.079251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:03:26.079251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 88a8db8d7d494c62b65e427278ef9a2a Sep 23 14:03:26.079251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-DeleteServersTestJSON-836308439-project Sep 23 14:03:26.079251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:03:26.079251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:26.079251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': 'fc990d71-8d2f-4734-a5b2-4401f24cc5b4'} Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:03:26.080081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:26.090142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:03:26.091948 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b372215e-56b0-4578-9844-7ff707d16e33 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Returning 404 to user: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:03:26.091948 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b372215e-56b0-4578-9844-7ff707d16e33 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 404 len: 111 microversion: 2.1 time: 0.037472 Sep 23 14:03:26.091948 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 78/148] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:26 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:03:26.299724 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9605bd2e-0b6e-45b4-9d68-57f7bccf0294 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:26.302114 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-9605bd2e-0b6e-45b4-9d68-57f7bccf0294 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:26.312477 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9605bd2e-0b6e-45b4-9d68-57f7bccf0294 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:26.313290 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9605bd2e-0b6e-45b4-9d68-57f7bccf0294 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:26.313887 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9605bd2e-0b6e-45b4-9d68-57f7bccf0294 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:26.314788 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9605bd2e-0b6e-45b4-9d68-57f7bccf0294 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:26.315419 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9605bd2e-0b6e-45b4-9d68-57f7bccf0294 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:26.315997 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9605bd2e-0b6e-45b4-9d68-57f7bccf0294 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:26.335668 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-9605bd2e-0b6e-45b4-9d68-57f7bccf0294 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] HTTP exception thrown: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9605bd2e-0b6e-45b4-9d68-57f7bccf0294 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Request method failure captured: Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4/os-volume_attachments HTTP/1.1 Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxsS7O0BYUBz8BmxUfYWDHzvXsZcJuBms38wT1lOBQUMR9bdYrIrH0sXlxCpciOjloT8i54bHauZXt7JmdvBJfyzkAbXc1-HvT-U9YAXTxfT1y1ER-5J9793sz0twr-zmEMD_k0al2CZnO2Dpr_ATXq87Kso1ACjRtfee8lrAiX5jc Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 8e1a67a82fb44cf59f9b4f30848881d1 Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-DeleteServersTestJSON-836308439 Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:03:26.340906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:03:26.342323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e1a67a82fb44cf59f9b4f30848881d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e1a67a82fb44cf59f9b4f30848881d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8e1a67a82fb44cf59f9b4f30848881d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8e1a67a82fb44cf59f9b4f30848881d1"}]}] Sep 23 14:03:26.342323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-DeleteServersTestJSON-836308439 Sep 23 14:03:26.342323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 8e1a67a82fb44cf59f9b4f30848881d1 Sep 23 14:03:26.342323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-DeleteServersTestJSON-836308439 Sep 23 14:03:26.342323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-DeleteServersTestJSON-836308439-project Sep 23 14:03:26.342323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:03:26.342323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:03:26.342323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 88a8db8d7d494c62b65e427278ef9a2a Sep 23 14:03:26.342323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-DeleteServersTestJSON-836308439-project Sep 23 14:03:26.342323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:03:26.342323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:26.342323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'server_id': 'fc990d71-8d2f-4734-a5b2-4401f24cc5b4'} Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:03:26.343225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:26.344999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:03:26.347554 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9605bd2e-0b6e-45b4-9d68-57f7bccf0294 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Returning 404 to user: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:03:26.348912 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-9605bd2e-0b6e-45b4-9d68-57f7bccf0294 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.057818 Sep 23 14:03:26.366428 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 71/149] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:03:26 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4/os-volume_attachments => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:03:26.922634 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-7e35f6c9-c1e5-4d5e-b13b-4b0504bbb532 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:26.927826 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-7e35f6c9-c1e5-4d5e-b13b-4b0504bbb532 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:26.930438 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7e35f6c9-c1e5-4d5e-b13b-4b0504bbb532 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:26.931191 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7e35f6c9-c1e5-4d5e-b13b-4b0504bbb532 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:26.932262 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7e35f6c9-c1e5-4d5e-b13b-4b0504bbb532 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:26.933196 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7e35f6c9-c1e5-4d5e-b13b-4b0504bbb532 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:26.933881 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7e35f6c9-c1e5-4d5e-b13b-4b0504bbb532 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:26.941500 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7e35f6c9-c1e5-4d5e-b13b-4b0504bbb532 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:27.103023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-7e35f6c9-c1e5-4d5e-b13b-4b0504bbb532 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:27.117014 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-7e35f6c9-c1e5-4d5e-b13b-4b0504bbb532 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.196924 Sep 23 14:03:27.117014 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 79/150] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:26 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:27.832298 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7d9a83cc-4ad3-49bc-93e2-3c3c2d896d67 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:27.832795 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7d9a83cc-4ad3-49bc-93e2-3c3c2d896d67 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:27.839456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7d9a83cc-4ad3-49bc-93e2-3c3c2d896d67 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:27.840255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7d9a83cc-4ad3-49bc-93e2-3c3c2d896d67 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:27.840698 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7d9a83cc-4ad3-49bc-93e2-3c3c2d896d67 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:27.841555 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7d9a83cc-4ad3-49bc-93e2-3c3c2d896d67 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:27.842014 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7d9a83cc-4ad3-49bc-93e2-3c3c2d896d67 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:27.842537 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7d9a83cc-4ad3-49bc-93e2-3c3c2d896d67 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:27.862509 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-7d9a83cc-4ad3-49bc-93e2-3c3c2d896d67 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] HTTP exception thrown: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7d9a83cc-4ad3-49bc-93e2-3c3c2d896d67 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Request method failure captured: Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: DELETE /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 HTTP/1.1 Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxsS7O0BYUBz8BmxUfYWDHzvXsZcJuBms38wT1lOBQUMR9bdYrIrH0sXlxCpciOjloT8i54bHauZXt7JmdvBJfyzkAbXc1-HvT-U9YAXTxfT1y1ER-5J9793sz0twr-zmEMD_k0al2CZnO2Dpr_ATXq87Kso1ACjRtfee8lrAiX5jc Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 8e1a67a82fb44cf59f9b4f30848881d1 Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-DeleteServersTestJSON-836308439 Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:03:27.864688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:03:27.865938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e1a67a82fb44cf59f9b4f30848881d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e1a67a82fb44cf59f9b4f30848881d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8e1a67a82fb44cf59f9b4f30848881d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8e1a67a82fb44cf59f9b4f30848881d1"}]}] Sep 23 14:03:27.865938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-DeleteServersTestJSON-836308439 Sep 23 14:03:27.865938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 8e1a67a82fb44cf59f9b4f30848881d1 Sep 23 14:03:27.865938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-DeleteServersTestJSON-836308439 Sep 23 14:03:27.865938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-DeleteServersTestJSON-836308439-project Sep 23 14:03:27.865938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:03:27.865938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:03:27.865938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 88a8db8d7d494c62b65e427278ef9a2a Sep 23 14:03:27.865938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-DeleteServersTestJSON-836308439-project Sep 23 14:03:27.865938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:03:27.865938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:27.865938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': 'fc990d71-8d2f-4734-a5b2-4401f24cc5b4'} Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:03:27.866774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:27.868023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:03:27.869294 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7d9a83cc-4ad3-49bc-93e2-3c3c2d896d67 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Returning 404 to user: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:03:27.869294 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7d9a83cc-4ad3-49bc-93e2-3c3c2d896d67 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 404 len: 111 microversion: 2.1 time: 0.039777 Sep 23 14:03:27.869294 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 72/151] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:03:27 2022] DELETE /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:03:27.876074 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-32e49f42-7331-4386-81c4-deb853375348 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:27.877483 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-32e49f42-7331-4386-81c4-deb853375348 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] [instance: fc990d71-8d2f-4734-a5b2-4401f24cc5b4] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:27.884923 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32e49f42-7331-4386-81c4-deb853375348 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:27.888686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32e49f42-7331-4386-81c4-deb853375348 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:27.888686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32e49f42-7331-4386-81c4-deb853375348 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:27.888686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32e49f42-7331-4386-81c4-deb853375348 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:27.888686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32e49f42-7331-4386-81c4-deb853375348 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:27.888974 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32e49f42-7331-4386-81c4-deb853375348 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:27.907347 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-32e49f42-7331-4386-81c4-deb853375348 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] HTTP exception thrown: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-32e49f42-7331-4386-81c4-deb853375348 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Request method failure captured: Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 HTTP/1.1 Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbxsS7O0BYUBz8BmxUfYWDHzvXsZcJuBms38wT1lOBQUMR9bdYrIrH0sXlxCpciOjloT8i54bHauZXt7JmdvBJfyzkAbXc1-HvT-U9YAXTxfT1y1ER-5J9793sz0twr-zmEMD_k0al2CZnO2Dpr_ATXq87Kso1ACjRtfee8lrAiX5jc Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 8e1a67a82fb44cf59f9b4f30848881d1 Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-DeleteServersTestJSON-836308439 Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:03:27.909841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:03:27.911064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e1a67a82fb44cf59f9b4f30848881d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e1a67a82fb44cf59f9b4f30848881d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8e1a67a82fb44cf59f9b4f30848881d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8e1a67a82fb44cf59f9b4f30848881d1"}]}] Sep 23 14:03:27.911064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-DeleteServersTestJSON-836308439 Sep 23 14:03:27.911064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 8e1a67a82fb44cf59f9b4f30848881d1 Sep 23 14:03:27.911064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-DeleteServersTestJSON-836308439 Sep 23 14:03:27.911064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-DeleteServersTestJSON-836308439-project Sep 23 14:03:27.911064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:03:27.911064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:03:27.911064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 88a8db8d7d494c62b65e427278ef9a2a Sep 23 14:03:27.911064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-DeleteServersTestJSON-836308439-project Sep 23 14:03:27.911064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:03:27.911064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:27.911064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': 'fc990d71-8d2f-4734-a5b2-4401f24cc5b4'} Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:03:27.911715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. Sep 23 14:03:27.912766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:03:27.917205 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-32e49f42-7331-4386-81c4-deb853375348 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] Returning 404 to user: Instance fc990d71-8d2f-4734-a5b2-4401f24cc5b4 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:03:27.920186 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-32e49f42-7331-4386-81c4-deb853375348 tempest-DeleteServersTestJSON-836308439 tempest-DeleteServersTestJSON-836308439-project] 10.222.0.62 "GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4" status: 404 len: 111 microversion: 2.1 time: 0.047327 Sep 23 14:03:27.921321 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 80/152] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:27 2022] GET /compute/v2.1/servers/fc990d71-8d2f-4734-a5b2-4401f24cc5b4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:03:28.139837 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-024009ac-66bd-48a9-b36c-c0ad906f45d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:28.141552 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-024009ac-66bd-48a9-b36c-c0ad906f45d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:28.150485 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-024009ac-66bd-48a9-b36c-c0ad906f45d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:28.151385 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-024009ac-66bd-48a9-b36c-c0ad906f45d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:28.152062 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-024009ac-66bd-48a9-b36c-c0ad906f45d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:28.153229 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-024009ac-66bd-48a9-b36c-c0ad906f45d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:28.154402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-024009ac-66bd-48a9-b36c-c0ad906f45d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:28.155054 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-024009ac-66bd-48a9-b36c-c0ad906f45d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:28.527636 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-024009ac-66bd-48a9-b36c-c0ad906f45d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:28.537867 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-024009ac-66bd-48a9-b36c-c0ad906f45d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.402270 Sep 23 14:03:28.539592 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 73/153] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:28 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:29.567238 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6c2f9840-9df0-4906-9a20-03a5084b6275 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:29.570264 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-6c2f9840-9df0-4906-9a20-03a5084b6275 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:29.617379 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6c2f9840-9df0-4906-9a20-03a5084b6275 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:29.618561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6c2f9840-9df0-4906-9a20-03a5084b6275 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:29.619527 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6c2f9840-9df0-4906-9a20-03a5084b6275 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:29.623066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6c2f9840-9df0-4906-9a20-03a5084b6275 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:29.625553 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6c2f9840-9df0-4906-9a20-03a5084b6275 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:29.633018 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6c2f9840-9df0-4906-9a20-03a5084b6275 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:30.007021 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-6c2f9840-9df0-4906-9a20-03a5084b6275 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:30.038869 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-6c2f9840-9df0-4906-9a20-03a5084b6275 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.476840 Sep 23 14:03:30.058285 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 81/154] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:29 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:31.091061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fea84324-3583-4894-a44b-e1e9483bdb1f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:31.095757 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-fea84324-3583-4894-a44b-e1e9483bdb1f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:31.103180 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fea84324-3583-4894-a44b-e1e9483bdb1f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:31.103875 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fea84324-3583-4894-a44b-e1e9483bdb1f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:31.104425 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fea84324-3583-4894-a44b-e1e9483bdb1f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:31.105467 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fea84324-3583-4894-a44b-e1e9483bdb1f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:31.106080 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fea84324-3583-4894-a44b-e1e9483bdb1f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:31.106545 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fea84324-3583-4894-a44b-e1e9483bdb1f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:31.351062 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fea84324-3583-4894-a44b-e1e9483bdb1f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:31.362031 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fea84324-3583-4894-a44b-e1e9483bdb1f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.276234 Sep 23 14:03:31.365494 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 74/155] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:31 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:03:32.401003 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-0e1e2495-913f-40a3-96c2-27fec130506c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:32.401750 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-0e1e2495-913f-40a3-96c2-27fec130506c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:32.410834 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0e1e2495-913f-40a3-96c2-27fec130506c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:32.411327 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0e1e2495-913f-40a3-96c2-27fec130506c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:32.411776 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0e1e2495-913f-40a3-96c2-27fec130506c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:32.412891 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0e1e2495-913f-40a3-96c2-27fec130506c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:32.413676 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0e1e2495-913f-40a3-96c2-27fec130506c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:32.414477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0e1e2495-913f-40a3-96c2-27fec130506c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:32.726282 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-0e1e2495-913f-40a3-96c2-27fec130506c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:32.747326 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-0e1e2495-913f-40a3-96c2-27fec130506c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.355112 Sep 23 14:03:32.762943 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 82/156] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:32 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:33.774051 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e253276d-91ae-46e6-85d6-fb24085a959a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:33.774689 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e253276d-91ae-46e6-85d6-fb24085a959a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:33.783298 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e253276d-91ae-46e6-85d6-fb24085a959a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:33.786461 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e253276d-91ae-46e6-85d6-fb24085a959a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:33.787092 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e253276d-91ae-46e6-85d6-fb24085a959a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:33.791605 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e253276d-91ae-46e6-85d6-fb24085a959a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:33.791605 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e253276d-91ae-46e6-85d6-fb24085a959a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:33.791605 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e253276d-91ae-46e6-85d6-fb24085a959a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:34.212199 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e253276d-91ae-46e6-85d6-fb24085a959a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:34.223180 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e253276d-91ae-46e6-85d6-fb24085a959a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.452809 Sep 23 14:03:34.224055 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 75/157] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:33 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:35.246271 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-66d951da-de03-463f-b63c-ee7882687ecd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:35.246946 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-66d951da-de03-463f-b63c-ee7882687ecd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:35.268932 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-66d951da-de03-463f-b63c-ee7882687ecd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:35.269403 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-66d951da-de03-463f-b63c-ee7882687ecd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:35.269849 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-66d951da-de03-463f-b63c-ee7882687ecd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:35.270584 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-66d951da-de03-463f-b63c-ee7882687ecd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:35.271208 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-66d951da-de03-463f-b63c-ee7882687ecd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:35.271956 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-66d951da-de03-463f-b63c-ee7882687ecd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:35.813856 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-66d951da-de03-463f-b63c-ee7882687ecd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:35.840653 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-66d951da-de03-463f-b63c-ee7882687ecd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1522 microversion: 2.1 time: 0.597386 Sep 23 14:03:35.841588 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 83/158] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:35 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1522 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:36.735473 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-68de8568-d0a3-42eb-8bb8-6dfd2edfa536 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Action: 'create', calling method: .version_select at 0x7f9083dabe50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1637587475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIo0c2ADQgI1L8+5iFLVwOukFkkh1HOTOyFRLHA49Vhgul356KiljEn+xqnK7k0Ne4xuztP9VnW/cEaT7liOJLUT65V4fNNp2uRR5lFv/NE67vgs1zMk0RH14IhekexAQ=="}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:03:36.763891 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-68de8568-d0a3-42eb-8bb8-6dfd2edfa536 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Getting quotas for project 901178273d85449e9cdaa5de235fb3e9. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:03:36.769991 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-68de8568-d0a3-42eb-8bb8-6dfd2edfa536 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Getting quotas for user 9359e90c4861470d9cc060abb9c3b203 and project 901178273d85449e9cdaa5de235fb3e9. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:03:36.875880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-68de8568-d0a3-42eb-8bb8-6dfd2edfa536 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.489882 Sep 23 14:03:36.876037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-44d73243-559e-4dfe-9d09-93b1095c04c4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:36.876963 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 76/159] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 23 14:03:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:03:36.883520 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-44d73243-559e-4dfe-9d09-93b1095c04c4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:36.889615 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-44d73243-559e-4dfe-9d09-93b1095c04c4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:36.890116 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-44d73243-559e-4dfe-9d09-93b1095c04c4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:36.890750 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-44d73243-559e-4dfe-9d09-93b1095c04c4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:36.892007 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-44d73243-559e-4dfe-9d09-93b1095c04c4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:36.909652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-44d73243-559e-4dfe-9d09-93b1095c04c4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:36.911970 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-44d73243-559e-4dfe-9d09-93b1095c04c4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:36.962087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:37.100332 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-44d73243-559e-4dfe-9d09-93b1095c04c4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:37.107984 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-44d73243-559e-4dfe-9d09-93b1095c04c4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1502 microversion: 2.1 time: 0.238464 Sep 23 14:03:37.109796 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 84/160] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:36 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1502 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:03:37.135906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-20024b1c-61b3-44cc-8ac1-bf8eed96a3fb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:37.136519 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-20024b1c-61b3-44cc-8ac1-bf8eed96a3fb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:37.143691 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-20024b1c-61b3-44cc-8ac1-bf8eed96a3fb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:37.144257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-20024b1c-61b3-44cc-8ac1-bf8eed96a3fb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:37.144845 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-20024b1c-61b3-44cc-8ac1-bf8eed96a3fb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:37.145621 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-20024b1c-61b3-44cc-8ac1-bf8eed96a3fb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:37.146151 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-20024b1c-61b3-44cc-8ac1-bf8eed96a3fb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:37.146669 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-20024b1c-61b3-44cc-8ac1-bf8eed96a3fb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:37.315703 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-20024b1c-61b3-44cc-8ac1-bf8eed96a3fb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:37.323838 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-20024b1c-61b3-44cc-8ac1-bf8eed96a3fb tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1516 microversion: 2.1 time: 0.191812 Sep 23 14:03:37.324741 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 77/161] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:37 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:39.377109 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-27107f91-ed82-42ff-810a-a12ddc86bda2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:03:39.379530 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-27107f91-ed82-42ff-810a-a12ddc86bda2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:39.391921 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27107f91-ed82-42ff-810a-a12ddc86bda2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:39.392680 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27107f91-ed82-42ff-810a-a12ddc86bda2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:39.393625 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27107f91-ed82-42ff-810a-a12ddc86bda2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:39.394686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27107f91-ed82-42ff-810a-a12ddc86bda2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:39.395991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27107f91-ed82-42ff-810a-a12ddc86bda2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:39.396634 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27107f91-ed82-42ff-810a-a12ddc86bda2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:39.423201 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-27107f91-ed82-42ff-810a-a12ddc86bda2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lazy-loading 'flavor' on Instance uuid 2af91809-ccf1-4b46-8778-e073f385d6ef {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:03:39.783573 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-27107f91-ed82-42ff-810a-a12ddc86bda2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "POST /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef/action" status: 200 len: 32 microversion: 2.1 time: 0.411313 Sep 23 14:03:39.786636 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 85/162] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 23 14:03:39 2022] POST /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef/action => generated 32 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 14:03:39.793981 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-286dc616-96f9-4fdb-8023-8e645c7780a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:39.795978 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-286dc616-96f9-4fdb-8023-8e645c7780a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:39.806436 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-286dc616-96f9-4fdb-8023-8e645c7780a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:39.807153 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-286dc616-96f9-4fdb-8023-8e645c7780a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:39.807891 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-286dc616-96f9-4fdb-8023-8e645c7780a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:39.808804 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-286dc616-96f9-4fdb-8023-8e645c7780a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:39.812217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-286dc616-96f9-4fdb-8023-8e645c7780a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:39.812217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-286dc616-96f9-4fdb-8023-8e645c7780a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:40.059101 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-286dc616-96f9-4fdb-8023-8e645c7780a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:40.075470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-286dc616-96f9-4fdb-8023-8e645c7780a4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.285689 Sep 23 14:03:40.078379 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 78/163] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:39 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:41.105545 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4c8072ff-0bf3-4ec7-899d-8664630874e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:41.106234 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4c8072ff-0bf3-4ec7-899d-8664630874e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:41.114304 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c8072ff-0bf3-4ec7-899d-8664630874e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:41.115142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c8072ff-0bf3-4ec7-899d-8664630874e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:41.115573 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c8072ff-0bf3-4ec7-899d-8664630874e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:41.117791 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c8072ff-0bf3-4ec7-899d-8664630874e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:41.118604 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c8072ff-0bf3-4ec7-899d-8664630874e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:41.119350 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c8072ff-0bf3-4ec7-899d-8664630874e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:41.331314 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4c8072ff-0bf3-4ec7-899d-8664630874e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:41.341585 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4c8072ff-0bf3-4ec7-899d-8664630874e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.240745 Sep 23 14:03:41.343674 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 86/164] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:41 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:42.367171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6a9809af-c1e0-4150-bb62-69cf39ccf8fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:42.367775 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6a9809af-c1e0-4150-bb62-69cf39ccf8fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:42.369907 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:42.375512 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6a9809af-c1e0-4150-bb62-69cf39ccf8fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:42.375998 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6a9809af-c1e0-4150-bb62-69cf39ccf8fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:42.376430 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6a9809af-c1e0-4150-bb62-69cf39ccf8fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:42.377116 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6a9809af-c1e0-4150-bb62-69cf39ccf8fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:42.377856 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6a9809af-c1e0-4150-bb62-69cf39ccf8fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:42.378500 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6a9809af-c1e0-4150-bb62-69cf39ccf8fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:42.573771 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6a9809af-c1e0-4150-bb62-69cf39ccf8fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:42.585154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6a9809af-c1e0-4150-bb62-69cf39ccf8fd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.221801 Sep 23 14:03:42.586418 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 79/165] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:42 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:43.609463 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-28507b52-8ae6-46ea-8bf6-05298c0db408 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:43.610814 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-28507b52-8ae6-46ea-8bf6-05298c0db408 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:43.617843 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28507b52-8ae6-46ea-8bf6-05298c0db408 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:43.629691 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28507b52-8ae6-46ea-8bf6-05298c0db408 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:43.630143 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28507b52-8ae6-46ea-8bf6-05298c0db408 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:43.644765 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28507b52-8ae6-46ea-8bf6-05298c0db408 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:43.644765 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28507b52-8ae6-46ea-8bf6-05298c0db408 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:43.644765 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28507b52-8ae6-46ea-8bf6-05298c0db408 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:43.907418 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-28507b52-8ae6-46ea-8bf6-05298c0db408 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:43.921194 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-28507b52-8ae6-46ea-8bf6-05298c0db408 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.315829 Sep 23 14:03:43.921991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 87/166] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:43 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:44.963948 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-2b5450f6-4074-4ab9-b1ff-a25ffddebd10 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:44.963948 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-2b5450f6-4074-4ab9-b1ff-a25ffddebd10 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:44.975462 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2b5450f6-4074-4ab9-b1ff-a25ffddebd10 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:44.976103 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2b5450f6-4074-4ab9-b1ff-a25ffddebd10 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:44.977053 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2b5450f6-4074-4ab9-b1ff-a25ffddebd10 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:44.977308 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2b5450f6-4074-4ab9-b1ff-a25ffddebd10 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:44.977972 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2b5450f6-4074-4ab9-b1ff-a25ffddebd10 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:44.978438 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2b5450f6-4074-4ab9-b1ff-a25ffddebd10 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:45.239431 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-2b5450f6-4074-4ab9-b1ff-a25ffddebd10 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:45.247849 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-2b5450f6-4074-4ab9-b1ff-a25ffddebd10 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.304166 Sep 23 14:03:45.250881 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 80/167] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:44 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:46.281777 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ca102744-efdf-42de-bcba-4ee9fcfd715c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:46.281777 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ca102744-efdf-42de-bcba-4ee9fcfd715c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:46.289932 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca102744-efdf-42de-bcba-4ee9fcfd715c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:46.290830 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca102744-efdf-42de-bcba-4ee9fcfd715c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:46.294647 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca102744-efdf-42de-bcba-4ee9fcfd715c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:46.296072 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca102744-efdf-42de-bcba-4ee9fcfd715c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:46.296918 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca102744-efdf-42de-bcba-4ee9fcfd715c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:46.298092 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca102744-efdf-42de-bcba-4ee9fcfd715c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:46.525538 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ca102744-efdf-42de-bcba-4ee9fcfd715c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:46.534699 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ca102744-efdf-42de-bcba-4ee9fcfd715c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.263799 Sep 23 14:03:46.546997 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 88/168] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:46 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:47.453478 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=4 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:47.559192 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d181ab8b-2b17-4b65-b6fd-e56974f40092 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:47.559854 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d181ab8b-2b17-4b65-b6fd-e56974f40092 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:47.580858 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d181ab8b-2b17-4b65-b6fd-e56974f40092 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:47.584005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d181ab8b-2b17-4b65-b6fd-e56974f40092 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:47.584005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d181ab8b-2b17-4b65-b6fd-e56974f40092 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:47.584005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d181ab8b-2b17-4b65-b6fd-e56974f40092 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:47.584701 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d181ab8b-2b17-4b65-b6fd-e56974f40092 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:47.585138 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d181ab8b-2b17-4b65-b6fd-e56974f40092 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:47.665671 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-dd9fec4f-e457-42d3-b887-c62f5038cc4b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Action: 'create', calling method: .version_select at 0x7f9083dab310>, body: {"keypair": {"name": "tempest-keypair-1836884531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdmxGacnjbkxNVnNLOPptpQe0iZsHs3NNV2+2/5smUmlpwK2F9WHfcmDjrswFlqlZYN46q3DmIw7bxTnHQJyU8cRhyFLFEo6RU3iUsNcYOrILktSN5k3CqHvAm7WbG+rg=="}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:03:47.702128 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-dd9fec4f-e457-42d3-b887-c62f5038cc4b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Getting quotas for project c21d140d48ba4014bc470e8cf720785d. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:03:47.706480 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-dd9fec4f-e457-42d3-b887-c62f5038cc4b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Getting quotas for user d777c43fe5c142b3b5ea5e2485f4e49f and project c21d140d48ba4014bc470e8cf720785d. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:03:47.799798 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-dd9fec4f-e457-42d3-b887-c62f5038cc4b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.364211 Sep 23 14:03:47.800479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 81/169] 10.222.0.62 () {62 vars in 1200 bytes} [Fri Sep 23 14:03:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 366 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 14:03:47.809376 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d181ab8b-2b17-4b65-b6fd-e56974f40092 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:47.818790 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d181ab8b-2b17-4b65-b6fd-e56974f40092 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.263501 Sep 23 14:03:47.819731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 89/170] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:47 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:48.000571 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4ef6a777-6e8a-4b74-9c43-1b5d04721ea2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:48.001389 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4ef6a777-6e8a-4b74-9c43-1b5d04721ea2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:48.009033 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4ef6a777-6e8a-4b74-9c43-1b5d04721ea2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:48.012550 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4ef6a777-6e8a-4b74-9c43-1b5d04721ea2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:48.012550 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4ef6a777-6e8a-4b74-9c43-1b5d04721ea2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:48.012550 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4ef6a777-6e8a-4b74-9c43-1b5d04721ea2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:48.012550 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4ef6a777-6e8a-4b74-9c43-1b5d04721ea2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:48.012864 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4ef6a777-6e8a-4b74-9c43-1b5d04721ea2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:48.099483 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4ef6a777-6e8a-4b74-9c43-1b5d04721ea2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/ips" status: 200 len: 150 microversion: 2.1 time: 0.051389 Sep 23 14:03:48.099483 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 82/171] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 23 14:03:47 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:03:48.844045 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4fb8c311-8b45-478f-8668-685516fb5c5a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:48.844716 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4fb8c311-8b45-478f-8668-685516fb5c5a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:48.851099 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4fb8c311-8b45-478f-8668-685516fb5c5a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:48.851595 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4fb8c311-8b45-478f-8668-685516fb5c5a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:48.854844 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4fb8c311-8b45-478f-8668-685516fb5c5a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:48.855822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4fb8c311-8b45-478f-8668-685516fb5c5a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:48.856683 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4fb8c311-8b45-478f-8668-685516fb5c5a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:48.857678 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4fb8c311-8b45-478f-8668-685516fb5c5a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:49.018831 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4fb8c311-8b45-478f-8668-685516fb5c5a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:49.034527 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4fb8c311-8b45-478f-8668-685516fb5c5a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.191490 Sep 23 14:03:49.035865 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 90/172] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:48 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:50.063466 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6e93296b-df0f-4e4e-a2c2-7902a1edceaf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:50.064102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6e93296b-df0f-4e4e-a2c2-7902a1edceaf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:50.098637 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e93296b-df0f-4e4e-a2c2-7902a1edceaf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:50.098637 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e93296b-df0f-4e4e-a2c2-7902a1edceaf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:50.098637 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e93296b-df0f-4e4e-a2c2-7902a1edceaf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:50.103043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e93296b-df0f-4e4e-a2c2-7902a1edceaf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:50.103572 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e93296b-df0f-4e4e-a2c2-7902a1edceaf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:50.104031 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e93296b-df0f-4e4e-a2c2-7902a1edceaf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:50.320674 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6e93296b-df0f-4e4e-a2c2-7902a1edceaf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:50.330552 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6e93296b-df0f-4e4e-a2c2-7902a1edceaf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.274741 Sep 23 14:03:50.332543 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 83/173] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:50 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:50.354735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9709dd1f-5896-434f-90d6-324875a71951 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0c380be-bbfd-4dd0-abe0-e09ff5c7f090"}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:03:50.358714 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9709dd1f-5896-434f-90d6-324875a71951 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:50.367404 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9709dd1f-5896-434f-90d6-324875a71951 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:50.368764 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9709dd1f-5896-434f-90d6-324875a71951 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:50.369413 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9709dd1f-5896-434f-90d6-324875a71951 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:50.370663 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9709dd1f-5896-434f-90d6-324875a71951 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:50.371215 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9709dd1f-5896-434f-90d6-324875a71951 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:50.371709 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9709dd1f-5896-434f-90d6-324875a71951 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:50.992311 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-991194776", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f2b1efa-9c49-4c4b-95ca-efb64f014785"}], "security_groups": [{"name": "tempest-securitygroup--1193639494"}], "key_name": "tempest-keypair-1836884531", "user_data": "}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:03:51.227725 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9709dd1f-5896-434f-90d6-324875a71951 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "POST /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.877850 Sep 23 14:03:51.233116 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 91/174] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 23 14:03:50 2022] POST /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments => generated 194 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:03:51.360592 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1bd0eef7-8be2-4e0e-879c-bdf4ed013c55 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:51.362784 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1bd0eef7-8be2-4e0e-879c-bdf4ed013c55 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:51.370438 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1bd0eef7-8be2-4e0e-879c-bdf4ed013c55 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:51.371383 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1bd0eef7-8be2-4e0e-879c-bdf4ed013c55 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:51.371945 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1bd0eef7-8be2-4e0e-879c-bdf4ed013c55 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:51.372843 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1bd0eef7-8be2-4e0e-879c-bdf4ed013c55 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:51.373585 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1bd0eef7-8be2-4e0e-879c-bdf4ed013c55 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:51.374236 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1bd0eef7-8be2-4e0e-879c-bdf4ed013c55 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:51.557870 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1bd0eef7-8be2-4e0e-879c-bdf4ed013c55 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:51.566454 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1bd0eef7-8be2-4e0e-879c-bdf4ed013c55 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.210980 Sep 23 14:03:51.567028 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 92/175] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:51 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:03:52.592109 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1eea9fc5-6e87-423a-a771-51d694dd97de tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:52.592764 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1eea9fc5-6e87-423a-a771-51d694dd97de tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:52.599943 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1eea9fc5-6e87-423a-a771-51d694dd97de tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:52.600710 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1eea9fc5-6e87-423a-a771-51d694dd97de tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:52.601154 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1eea9fc5-6e87-423a-a771-51d694dd97de tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:52.601893 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1eea9fc5-6e87-423a-a771-51d694dd97de tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:52.602385 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1eea9fc5-6e87-423a-a771-51d694dd97de tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:52.602811 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1eea9fc5-6e87-423a-a771-51d694dd97de tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:52.758360 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1eea9fc5-6e87-423a-a771-51d694dd97de tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:52.766769 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1eea9fc5-6e87-423a-a771-51d694dd97de tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.179158 Sep 23 14:03:52.767327 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 93/176] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:52 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:03:53.796207 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4c474b6e-1c58-4e63-96a3-6d22f099762d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:53.797089 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4c474b6e-1c58-4e63-96a3-6d22f099762d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:53.800247 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=42 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:53.804953 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c474b6e-1c58-4e63-96a3-6d22f099762d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:53.805445 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c474b6e-1c58-4e63-96a3-6d22f099762d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:53.805882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c474b6e-1c58-4e63-96a3-6d22f099762d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:53.806612 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c474b6e-1c58-4e63-96a3-6d22f099762d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:53.807072 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c474b6e-1c58-4e63-96a3-6d22f099762d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:53.807514 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c474b6e-1c58-4e63-96a3-6d22f099762d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:53.948627 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4c474b6e-1c58-4e63-96a3-6d22f099762d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:53.957693 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4c474b6e-1c58-4e63-96a3-6d22f099762d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.171086 Sep 23 14:03:53.958453 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 94/177] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:53 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:03:54.981201 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6babd5d2-ff82-4d32-ad7a-a2ff84c0f860 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:54.983157 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-6babd5d2-ff82-4d32-ad7a-a2ff84c0f860 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:54.990107 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6babd5d2-ff82-4d32-ad7a-a2ff84c0f860 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:54.992975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6babd5d2-ff82-4d32-ad7a-a2ff84c0f860 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:54.992975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6babd5d2-ff82-4d32-ad7a-a2ff84c0f860 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:54.992975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6babd5d2-ff82-4d32-ad7a-a2ff84c0f860 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:54.992975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6babd5d2-ff82-4d32-ad7a-a2ff84c0f860 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:54.993510 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6babd5d2-ff82-4d32-ad7a-a2ff84c0f860 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:55.134942 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-6babd5d2-ff82-4d32-ad7a-a2ff84c0f860 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:55.143557 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-6babd5d2-ff82-4d32-ad7a-a2ff84c0f860 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.166590 Sep 23 14:03:55.144262 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 95/178] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:54 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:03:56.167616 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-02ac8058-c5d9-4eec-a91d-c39e8d585bb0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:56.168236 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-02ac8058-c5d9-4eec-a91d-c39e8d585bb0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:56.175369 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-02ac8058-c5d9-4eec-a91d-c39e8d585bb0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:56.175869 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-02ac8058-c5d9-4eec-a91d-c39e8d585bb0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:56.176335 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-02ac8058-c5d9-4eec-a91d-c39e8d585bb0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:56.177022 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-02ac8058-c5d9-4eec-a91d-c39e8d585bb0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:56.177477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-02ac8058-c5d9-4eec-a91d-c39e8d585bb0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:56.177914 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-02ac8058-c5d9-4eec-a91d-c39e8d585bb0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:56.315317 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-02ac8058-c5d9-4eec-a91d-c39e8d585bb0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:56.323643 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-02ac8058-c5d9-4eec-a91d-c39e8d585bb0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.160050 Sep 23 14:03:56.324360 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 96/179] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:56 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:03:57.346816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ab72b77f-ba36-4c32-a76b-ac37284c7e3e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:57.347467 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ab72b77f-ba36-4c32-a76b-ac37284c7e3e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:57.353723 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab72b77f-ba36-4c32-a76b-ac37284c7e3e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:57.354205 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab72b77f-ba36-4c32-a76b-ac37284c7e3e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:57.354678 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab72b77f-ba36-4c32-a76b-ac37284c7e3e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:57.355361 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab72b77f-ba36-4c32-a76b-ac37284c7e3e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:57.355839 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab72b77f-ba36-4c32-a76b-ac37284c7e3e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:57.356260 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ab72b77f-ba36-4c32-a76b-ac37284c7e3e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:57.635007 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ab72b77f-ba36-4c32-a76b-ac37284c7e3e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:57.638366 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:57.642931 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ab72b77f-ba36-4c32-a76b-ac37284c7e3e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.300195 Sep 23 14:03:57.643500 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 97/180] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:57 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:03:57.788640 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.network.neutron [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] validate_networks() for [('0f2b1efa-9c49-4c4b-95ca-efb64f014785', None, None, None, None, None)] {{(pid=121074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:03:58.008307 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=4 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:58.162958 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Flavor limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:03:58.163411 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Image limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:03:58.163890 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Flavor pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:03:58.164304 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Image pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:03:58.164766 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:03:58.174444 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:58.174930 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:58.175367 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:58.176097 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:58.176611 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:58.177160 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:58.183855 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=87 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:58.194696 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Getting quotas for project c21d140d48ba4014bc470e8cf720785d. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:03:58.198816 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Getting quotas for user d777c43fe5c142b3b5ea5e2485f4e49f and project c21d140d48ba4014bc470e8cf720785d. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:03:58.211260 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Going to run 1 instances... {{(pid=121074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:03:58.213589 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:03:58.348267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1dbe3f82-ebc2-4ea4-8bc4-9f6b8df2441c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 7.362066 Sep 23 14:03:58.348948 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 84/181] 10.222.0.62 () {62 vars in 1188 bytes} [Fri Sep 23 14:03:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 7363 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 23 14:03:58.361153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c59c0443-3f98-4ff1-abf2-28c47760e004 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:58.362407 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c59c0443-3f98-4ff1-abf2-28c47760e004 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:58.420293 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c59c0443-3f98-4ff1-abf2-28c47760e004 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:58.429204 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c59c0443-3f98-4ff1-abf2-28c47760e004 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:58.430701 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c59c0443-3f98-4ff1-abf2-28c47760e004 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:58.431826 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c59c0443-3f98-4ff1-abf2-28c47760e004 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1281 microversion: 2.20 time: 0.075284 Sep 23 14:03:58.432371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 98/182] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:03:58 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:03:58.673217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5abbcad6-8d72-4e38-bac5-35b7907d9390 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:58.673604 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-5abbcad6-8d72-4e38-bac5-35b7907d9390 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:58.681066 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5abbcad6-8d72-4e38-bac5-35b7907d9390 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:58.681569 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5abbcad6-8d72-4e38-bac5-35b7907d9390 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:58.682012 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5abbcad6-8d72-4e38-bac5-35b7907d9390 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:58.682735 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5abbcad6-8d72-4e38-bac5-35b7907d9390 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:58.683196 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5abbcad6-8d72-4e38-bac5-35b7907d9390 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:58.683628 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5abbcad6-8d72-4e38-bac5-35b7907d9390 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:58.832215 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5abbcad6-8d72-4e38-bac5-35b7907d9390 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:58.839871 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5abbcad6-8d72-4e38-bac5-35b7907d9390 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.171347 Sep 23 14:03:58.840429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 85/183] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:58 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:03:59.458139 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4b7de392-18a0-466e-8782-bb2b054cdb70 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:59.458758 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4b7de392-18a0-466e-8782-bb2b054cdb70 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:59.467417 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4b7de392-18a0-466e-8782-bb2b054cdb70 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:59.467899 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4b7de392-18a0-466e-8782-bb2b054cdb70 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:59.468333 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4b7de392-18a0-466e-8782-bb2b054cdb70 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:59.469014 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4b7de392-18a0-466e-8782-bb2b054cdb70 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:59.469597 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4b7de392-18a0-466e-8782-bb2b054cdb70 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:59.470018 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4b7de392-18a0-466e-8782-bb2b054cdb70 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:59.537035 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4b7de392-18a0-466e-8782-bb2b054cdb70 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:59.545085 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4b7de392-18a0-466e-8782-bb2b054cdb70 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:59.546829 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4b7de392-18a0-466e-8782-bb2b054cdb70 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:03:59.547940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4b7de392-18a0-466e-8782-bb2b054cdb70 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1285 microversion: 2.20 time: 0.094502 Sep 23 14:03:59.548493 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 99/184] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:03:59 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:03:59.862837 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0f681f0f-7ac7-44e6-9b97-cfed5f8832db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:03:59.863579 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-0f681f0f-7ac7-44e6-9b97-cfed5f8832db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:03:59.869851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f681f0f-7ac7-44e6-9b97-cfed5f8832db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:59.870482 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f681f0f-7ac7-44e6-9b97-cfed5f8832db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:59.871024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f681f0f-7ac7-44e6-9b97-cfed5f8832db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:59.871809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f681f0f-7ac7-44e6-9b97-cfed5f8832db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:03:59.872914 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f681f0f-7ac7-44e6-9b97-cfed5f8832db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:03:59.873470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f681f0f-7ac7-44e6-9b97-cfed5f8832db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:03:59.881201 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d1502905-c66c-4513-8d15-dad57774e908 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Action: 'create', calling method: .version_select at 0x7f9083caf280>, body: {"keypair": {"name": "tempest-keypair-48573208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeJE9sOdsawIUeY0FxlK6QXaDHRK6tvck0Os8SGD7BpOll7IrP+lk0z6Hbmqo/mq8H1t1RRJRX37Nwdomc10tphmOL/sFapsdjD5hxDn+en2zAwKGLSXG2dM7p+iuGUuA=="}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:03:59.906270 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-d1502905-c66c-4513-8d15-dad57774e908 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for project 482490c45ac64607bba9ad021f2effbf. Resources: {'key_pairs'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:03:59.910528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-d1502905-c66c-4513-8d15-dad57774e908 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for user 0db30f990aae49fabf9b8b19cd019de9 and project 482490c45ac64607bba9ad021f2effbf. Resources: {'key_pairs'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:04:00.015153 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-0f681f0f-7ac7-44e6-9b97-cfed5f8832db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:00.022781 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-0f681f0f-7ac7-44e6-9b97-cfed5f8832db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.163681 Sep 23 14:04:00.023352 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 86/185] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:03:59 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:00.031268 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d1502905-c66c-4513-8d15-dad57774e908 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.154507 Sep 23 14:04:00.032313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 100/186] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 23 14:03:59 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:04:00.573218 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0ce41fe4-fd9c-48a5-bf4d-b2e71a0c93d6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:00.573832 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-0ce41fe4-fd9c-48a5-bf4d-b2e71a0c93d6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:00.580455 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0ce41fe4-fd9c-48a5-bf4d-b2e71a0c93d6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:00.580947 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0ce41fe4-fd9c-48a5-bf4d-b2e71a0c93d6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:00.581382 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0ce41fe4-fd9c-48a5-bf4d-b2e71a0c93d6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:00.582105 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0ce41fe4-fd9c-48a5-bf4d-b2e71a0c93d6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:00.582599 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0ce41fe4-fd9c-48a5-bf4d-b2e71a0c93d6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:00.583028 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0ce41fe4-fd9c-48a5-bf4d-b2e71a0c93d6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:00.649684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-0ce41fe4-fd9c-48a5-bf4d-b2e71a0c93d6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:00.658269 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-0ce41fe4-fd9c-48a5-bf4d-b2e71a0c93d6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:00.659735 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-0ce41fe4-fd9c-48a5-bf4d-b2e71a0c93d6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:00.660834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-0ce41fe4-fd9c-48a5-bf4d-b2e71a0c93d6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1333 microversion: 2.20 time: 0.091609 Sep 23 14:04:00.661382 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 87/187] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:00 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:04:01.047401 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1ebea080-1a95-4a56-851a-51eabce5a9b1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:01.048022 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1ebea080-1a95-4a56-851a-51eabce5a9b1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:01.054865 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1ebea080-1a95-4a56-851a-51eabce5a9b1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:01.055354 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1ebea080-1a95-4a56-851a-51eabce5a9b1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:01.055793 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1ebea080-1a95-4a56-851a-51eabce5a9b1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:01.056480 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1ebea080-1a95-4a56-851a-51eabce5a9b1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:01.056932 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1ebea080-1a95-4a56-851a-51eabce5a9b1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:01.057353 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1ebea080-1a95-4a56-851a-51eabce5a9b1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:01.203158 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1ebea080-1a95-4a56-851a-51eabce5a9b1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:01.210825 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1ebea080-1a95-4a56-851a-51eabce5a9b1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.168814 Sep 23 14:04:01.211392 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 101/188] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:01 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:01.699794 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d05fbacd-b299-49d0-bcfb-184346067200 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:01.701164 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d05fbacd-b299-49d0-bcfb-184346067200 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:01.707453 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d05fbacd-b299-49d0-bcfb-184346067200 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:01.707942 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d05fbacd-b299-49d0-bcfb-184346067200 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:01.708382 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d05fbacd-b299-49d0-bcfb-184346067200 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:01.709076 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d05fbacd-b299-49d0-bcfb-184346067200 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:01.709531 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d05fbacd-b299-49d0-bcfb-184346067200 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:01.709956 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d05fbacd-b299-49d0-bcfb-184346067200 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:01.771873 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d05fbacd-b299-49d0-bcfb-184346067200 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:01.781737 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d05fbacd-b299-49d0-bcfb-184346067200 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:01.783453 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d05fbacd-b299-49d0-bcfb-184346067200 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:01.785932 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d05fbacd-b299-49d0-bcfb-184346067200 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1339 microversion: 2.20 time: 0.088894 Sep 23 14:04:01.803112 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 88/189] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:01 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1339 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:04:02.235566 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9d29e5af-708b-4d65-9fb5-45103d416fc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:02.236237 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9d29e5af-708b-4d65-9fb5-45103d416fc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:02.243020 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d29e5af-708b-4d65-9fb5-45103d416fc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:02.247478 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d29e5af-708b-4d65-9fb5-45103d416fc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:02.247951 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d29e5af-708b-4d65-9fb5-45103d416fc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:02.248903 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d29e5af-708b-4d65-9fb5-45103d416fc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:02.249378 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d29e5af-708b-4d65-9fb5-45103d416fc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:02.249813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d29e5af-708b-4d65-9fb5-45103d416fc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:02.388811 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9d29e5af-708b-4d65-9fb5-45103d416fc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:02.396848 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9d29e5af-708b-4d65-9fb5-45103d416fc6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.166045 Sep 23 14:04:02.397783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 102/190] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:02 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:02.792442 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1409389229", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34e7a0c6-e35b-482b-a11c-b3c893e03a50"}], "security_groups": [{"name": "tempest-securitygroup--2132246369"}], "key_name": "tempest-keypair-48573208", "user_data": "}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:02.811248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-05ce1fb0-3a2c-4759-a3c9-99354bdeefad tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:02.811933 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-05ce1fb0-3a2c-4759-a3c9-99354bdeefad tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:02.817837 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-05ce1fb0-3a2c-4759-a3c9-99354bdeefad tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:02.818549 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-05ce1fb0-3a2c-4759-a3c9-99354bdeefad tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:02.818988 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-05ce1fb0-3a2c-4759-a3c9-99354bdeefad tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:02.819678 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-05ce1fb0-3a2c-4759-a3c9-99354bdeefad tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:02.820132 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-05ce1fb0-3a2c-4759-a3c9-99354bdeefad tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:02.820552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-05ce1fb0-3a2c-4759-a3c9-99354bdeefad tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:02.944850 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.network.neutron [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] validate_networks() for [('34e7a0c6-e35b-482b-a11c-b3c893e03a50', None, None, None, None, None)] {{(pid=121074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:04:03.036626 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-05ce1fb0-3a2c-4759-a3c9-99354bdeefad tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:03.045249 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-05ce1fb0-3a2c-4759-a3c9-99354bdeefad tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:03.046997 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-05ce1fb0-3a2c-4759-a3c9-99354bdeefad tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:03.048105 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-05ce1fb0-3a2c-4759-a3c9-99354bdeefad tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1407 microversion: 2.20 time: 0.240744 Sep 23 14:04:03.048666 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 103/191] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:02 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:04:03.421503 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e7117407-c39a-4d0f-81fe-d6a8b7e41de3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:03.422167 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e7117407-c39a-4d0f-81fe-d6a8b7e41de3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:03.431264 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e7117407-c39a-4d0f-81fe-d6a8b7e41de3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:03.432036 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e7117407-c39a-4d0f-81fe-d6a8b7e41de3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:03.432631 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e7117407-c39a-4d0f-81fe-d6a8b7e41de3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:03.433825 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e7117407-c39a-4d0f-81fe-d6a8b7e41de3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:03.435713 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e7117407-c39a-4d0f-81fe-d6a8b7e41de3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:03.436321 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e7117407-c39a-4d0f-81fe-d6a8b7e41de3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:03.683424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Flavor limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:04:03.683980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Image limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:04:03.685414 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Flavor pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:04:03.685975 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Image pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:04:03.686529 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:04:03.699562 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:03.700772 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:03.702406 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:03.703131 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:03.704014 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:03.705203 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:03.732099 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for project 482490c45ac64607bba9ad021f2effbf. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:04:03.737197 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e7117407-c39a-4d0f-81fe-d6a8b7e41de3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:03.749339 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e7117407-c39a-4d0f-81fe-d6a8b7e41de3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.332620 Sep 23 14:04:03.749526 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for user 0db30f990aae49fabf9b8b19cd019de9 and project 482490c45ac64607bba9ad021f2effbf. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:04:03.762894 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 104/192] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:03 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:03.768502 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Going to run 1 instances... {{(pid=121074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:04:03.772531 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:04:03.901700 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-2676b7dd-77e4-4cdf-b93c-45a60f66218d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.113404 Sep 23 14:04:03.913053 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 89/193] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:04:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 14:04:03.915896 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f6307eb3-d78a-44bd-ac2d-64fcfac74e4e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:03.917249 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f6307eb3-d78a-44bd-ac2d-64fcfac74e4e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:04.016465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f6307eb3-d78a-44bd-ac2d-64fcfac74e4e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:04.025641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f6307eb3-d78a-44bd-ac2d-64fcfac74e4e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1240 microversion: 2.1 time: 0.114838 Sep 23 14:04:04.028786 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 105/194] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:03 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1240 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:04.073490 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8f9a3596-6110-49fb-8e30-5e1856f270c3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:04.074436 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8f9a3596-6110-49fb-8e30-5e1856f270c3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:04.085936 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8f9a3596-6110-49fb-8e30-5e1856f270c3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:04.089094 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8f9a3596-6110-49fb-8e30-5e1856f270c3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:04.089658 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8f9a3596-6110-49fb-8e30-5e1856f270c3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:04.093049 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8f9a3596-6110-49fb-8e30-5e1856f270c3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:04.094067 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8f9a3596-6110-49fb-8e30-5e1856f270c3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:04.094673 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8f9a3596-6110-49fb-8e30-5e1856f270c3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:04.263752 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8f9a3596-6110-49fb-8e30-5e1856f270c3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:04.275411 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8f9a3596-6110-49fb-8e30-5e1856f270c3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:04.276873 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8f9a3596-6110-49fb-8e30-5e1856f270c3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:04.278075 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8f9a3596-6110-49fb-8e30-5e1856f270c3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1407 microversion: 2.20 time: 0.208749 Sep 23 14:04:04.278652 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 90/195] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:04 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:04:04.355614 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-56452da0-c235-49d9-9790-f3a2cc4305db req-12876501-3f03-497c-b05f-61296022951c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97557fbe-c1f4-464e-93b8-3c71fbc48936", "tag": "0765d95c-b5b8-4eb9-aef1-96129a9a206d"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:04.365475 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-56452da0-c235-49d9-9790-f3a2cc4305db req-12876501-3f03-497c-b05f-61296022951c service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:04.366185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-56452da0-c235-49d9-9790-f3a2cc4305db req-12876501-3f03-497c-b05f-61296022951c service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:04.366645 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-56452da0-c235-49d9-9790-f3a2cc4305db req-12876501-3f03-497c-b05f-61296022951c service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:04.378395 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-56452da0-c235-49d9-9790-f3a2cc4305db req-12876501-3f03-497c-b05f-61296022951c service nova] Creating event network-changed:0765d95c-b5b8-4eb9-aef1-96129a9a206d for instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 on hv-cinder-85743 Sep 23 14:04:04.383665 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-56452da0-c235-49d9-9790-f3a2cc4305db req-12876501-3f03-497c-b05f-61296022951c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031857 Sep 23 14:04:04.384257 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 106/196] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:04:04.782128 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-15b7c79e-8bc4-4a83-aa6b-0b882d7ecee2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:04.782128 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-15b7c79e-8bc4-4a83-aa6b-0b882d7ecee2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:04.786620 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-15b7c79e-8bc4-4a83-aa6b-0b882d7ecee2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:04.787158 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-15b7c79e-8bc4-4a83-aa6b-0b882d7ecee2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:04.787585 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-15b7c79e-8bc4-4a83-aa6b-0b882d7ecee2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:04.788495 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-15b7c79e-8bc4-4a83-aa6b-0b882d7ecee2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:04.788966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-15b7c79e-8bc4-4a83-aa6b-0b882d7ecee2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:04.789414 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-15b7c79e-8bc4-4a83-aa6b-0b882d7ecee2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:04.935691 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-15b7c79e-8bc4-4a83-aa6b-0b882d7ecee2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:04.947486 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-15b7c79e-8bc4-4a83-aa6b-0b882d7ecee2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.173243 Sep 23 14:04:04.947991 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 91/197] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:04 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:05.052161 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d330b9c4-bf71-4ace-9f81-00c23707461c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:05.052925 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d330b9c4-bf71-4ace-9f81-00c23707461c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:05.060492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d330b9c4-bf71-4ace-9f81-00c23707461c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:05.060987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d330b9c4-bf71-4ace-9f81-00c23707461c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:05.061429 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d330b9c4-bf71-4ace-9f81-00c23707461c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:05.062152 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d330b9c4-bf71-4ace-9f81-00c23707461c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:05.062615 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d330b9c4-bf71-4ace-9f81-00c23707461c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:05.063038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d330b9c4-bf71-4ace-9f81-00c23707461c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:05.124743 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d330b9c4-bf71-4ace-9f81-00c23707461c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:05.132371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d330b9c4-bf71-4ace-9f81-00c23707461c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1244 microversion: 2.1 time: 0.084563 Sep 23 14:04:05.132931 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 107/198] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:05 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:05.303384 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-220599c4-2187-431f-9587-98a221b61308 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:05.303993 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-220599c4-2187-431f-9587-98a221b61308 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:05.310718 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-220599c4-2187-431f-9587-98a221b61308 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:05.311242 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-220599c4-2187-431f-9587-98a221b61308 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:05.311652 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-220599c4-2187-431f-9587-98a221b61308 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:05.312791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-220599c4-2187-431f-9587-98a221b61308 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:05.313250 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-220599c4-2187-431f-9587-98a221b61308 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:05.313679 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-220599c4-2187-431f-9587-98a221b61308 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:05.338833 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-57881738", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1637587475", "security_groups": [{"name": "tempest-secgroup-smoke-195226751"}], "block_device_mapping_v2": [{"uuid": "6b5db45c-f08b-4d06-a01b-76d5c5896531", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "85b65927-108e-4662-8841-432429780256"}]}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:05.482375 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-220599c4-2187-431f-9587-98a221b61308 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:05.490496 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-220599c4-2187-431f-9587-98a221b61308 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:05.491398 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.network.neutron [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] validate_networks() for [('85b65927-108e-4662-8841-432429780256', None, None, None, None, None)] {{(pid=121073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:04:05.492176 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-220599c4-2187-431f-9587-98a221b61308 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:05.493291 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-220599c4-2187-431f-9587-98a221b61308 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1407 microversion: 2.20 time: 0.193783 Sep 23 14:04:05.493839 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 92/199] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:05 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:04:05.872621 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Flavor limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:04:05.873041 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Image limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:04:05.873516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Flavor pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:04:05.873926 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Image pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:04:05.874349 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:04:05.883041 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:05.883525 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:05.883966 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:05.884690 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:05.885156 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:05.885583 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:05.902660 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Getting quotas for project 901178273d85449e9cdaa5de235fb3e9. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:04:05.906631 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Getting quotas for user 9359e90c4861470d9cc060abb9c3b203 and project 901178273d85449e9cdaa5de235fb3e9. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:04:05.963057 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Going to run 1 instances... {{(pid=121073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:04:05.965192 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b5db45c-f08b-4d06-a01b-76d5c5896531',volume_size=None,volume_type=None)] {{(pid=121073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:04:05.970165 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-933f18f3-17da-4639-b3ec-c8c61f50d37a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:05.970812 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-933f18f3-17da-4639-b3ec-c8c61f50d37a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:05.976681 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-933f18f3-17da-4639-b3ec-c8c61f50d37a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:05.977169 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-933f18f3-17da-4639-b3ec-c8c61f50d37a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:05.977610 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-933f18f3-17da-4639-b3ec-c8c61f50d37a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:05.978293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-933f18f3-17da-4639-b3ec-c8c61f50d37a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:05.978778 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-933f18f3-17da-4639-b3ec-c8c61f50d37a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:05.979206 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-933f18f3-17da-4639-b3ec-c8c61f50d37a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:06.109563 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-933f18f3-17da-4639-b3ec-c8c61f50d37a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:06.117216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-933f18f3-17da-4639-b3ec-c8c61f50d37a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1502 microversion: 2.1 time: 0.150766 Sep 23 14:04:06.117788 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 93/200] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:05 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:06.145095 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-caeb1605-808d-4038-b923-36233e47e2d2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fac92408-d123-419b-8777-a3430cfba748"}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:06.147622 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-caeb1605-808d-4038-b923-36233e47e2d2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:06.155892 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-caeb1605-808d-4038-b923-36233e47e2d2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:06.156395 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-caeb1605-808d-4038-b923-36233e47e2d2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:06.156852 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-caeb1605-808d-4038-b923-36233e47e2d2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:06.157573 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-caeb1605-808d-4038-b923-36233e47e2d2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:06.158030 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-caeb1605-808d-4038-b923-36233e47e2d2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:06.158494 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-caeb1605-808d-4038-b923-36233e47e2d2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:06.182985 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-caeb1605-808d-4038-b923-36233e47e2d2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] HTTP exception thrown: Cannot 'attach_volume' instance 2af91809-ccf1-4b46-8778-e073f385d6ef while it is in vm_state rescued Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-caeb1605-808d-4038-b923-36233e47e2d2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Request method failure captured: Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: POST /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef/os-volume_attachments HTTP/1.1 Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 74 Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxnzDm6DgW0nTYDFDzi5SOHvSPJ6hZrF_pz9Ph0XCziqGU45FO9Ids8cW2I9WFrbXMdkl7DdqmLLFpEppSALkiMXJRcKEd-oKGJ1eeg29_bry9MG0PBEvVfdfr6Lqo4PU_2dBPb3P4fhNFCVeOEEyfkxVL-v3y86ZS4kPvYsqdra7o Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: d08a219027684089a91c354749c67d5d Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:04:06.185213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:04:06.186877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d08a219027684089a91c354749c67d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d08a219027684089a91c354749c67d5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d08a219027684089a91c354749c67d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d08a219027684089a91c354749c67d5d"}]}] Sep 23 14:04:06.186877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:04:06.186877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: d08a219027684089a91c354749c67d5d Sep 23 14:04:06.186877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:04:06.186877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-ServerRescueNegativeTestJSON-1299274290-project Sep 23 14:04:06.186877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:04:06.186877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:04:06.186877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 28b64a35d7b44519a1d93919f2e23083 Sep 23 14:04:06.186877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1299274290-project Sep 23 14:04:06.186877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Sep 23 14:04:06.186877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {"volumeAttachment": {"volumeId": "fac92408-d123-419b-8777-a3430cfba748"}} Sep 23 14:04:06.186877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Cannot 'attach_volume' instance 2af91809-ccf1-4b46-8778-e073f385d6ef while it is in vm_state rescued Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'server_id': '2af91809-ccf1-4b46-8778-e073f385d6ef', 'body': {'volumeAttachment': {'volumeId': 'fac92408-d123-419b-8777-a3430cfba748'}}} Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2af91809-ccf1-4b46-8778-e073f385d6ef in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:04:06.187780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2af91809-ccf1-4b46-8778-e073f385d6ef while it is in vm_state rescued Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:04:06.189171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:04:06.190460 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:04:06.190460 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:04:06.190460 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2af91809-ccf1-4b46-8778-e073f385d6ef while it is in vm_state rescued Sep 23 14:04:06.190460 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:04:06.190460 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-caeb1605-808d-4038-b923-36233e47e2d2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Returning 409 to user: Cannot 'attach_volume' instance 2af91809-ccf1-4b46-8778-e073f385d6ef while it is in vm_state rescued {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:04:06.190460 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-caeb1605-808d-4038-b923-36233e47e2d2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "POST /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045756 Sep 23 14:04:06.190460 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 94/201] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 23 14:04:06 2022] POST /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 23 14:04:06.195276 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-844ac32c-1a0f-415e-b25c-7398fcec6547 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:06.195878 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-844ac32c-1a0f-415e-b25c-7398fcec6547 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:06.202547 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-844ac32c-1a0f-415e-b25c-7398fcec6547 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:06.203090 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-844ac32c-1a0f-415e-b25c-7398fcec6547 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:06.203526 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-844ac32c-1a0f-415e-b25c-7398fcec6547 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:06.204259 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-844ac32c-1a0f-415e-b25c-7398fcec6547 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:06.204710 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-844ac32c-1a0f-415e-b25c-7398fcec6547 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:06.205129 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-844ac32c-1a0f-415e-b25c-7398fcec6547 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:06.267737 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-844ac32c-1a0f-415e-b25c-7398fcec6547 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:06.275300 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-844ac32c-1a0f-415e-b25c-7398fcec6547 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1244 microversion: 2.1 time: 0.083848 Sep 23 14:04:06.275857 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 95/202] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:06 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:06.281253 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ac25fb0b-0497-437c-8bc4-00757ac1929e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:06.281772 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ac25fb0b-0497-437c-8bc4-00757ac1929e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:06.288435 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ac25fb0b-0497-437c-8bc4-00757ac1929e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:06.289111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ac25fb0b-0497-437c-8bc4-00757ac1929e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:06.289552 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ac25fb0b-0497-437c-8bc4-00757ac1929e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:06.290283 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ac25fb0b-0497-437c-8bc4-00757ac1929e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:06.290786 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ac25fb0b-0497-437c-8bc4-00757ac1929e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:06.291327 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ac25fb0b-0497-437c-8bc4-00757ac1929e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:06.443470 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b9d28858-65d2-4adc-9366-108ec3e5992e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.108280 Sep 23 14:04:06.444545 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 108/203] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:04:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 14:04:06.455923 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-24b51047-f425-4ec0-b76b-ac2703ecc293 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:06.456530 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-24b51047-f425-4ec0-b76b-ac2703ecc293 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:06.491223 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ac25fb0b-0497-437c-8bc4-00757ac1929e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "POST /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef/action" status: 202 len: 0 microversion: 2.1 time: 0.213945 Sep 23 14:04:06.494978 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 96/204] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 23 14:04:06 2022] POST /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:04:06.500480 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7a5d3e60-9f3f-40c0-9c96-097a006293e3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:06.501162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7a5d3e60-9f3f-40c0-9c96-097a006293e3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:06.508617 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7a5d3e60-9f3f-40c0-9c96-097a006293e3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:06.509109 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7a5d3e60-9f3f-40c0-9c96-097a006293e3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:06.509546 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7a5d3e60-9f3f-40c0-9c96-097a006293e3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:06.510240 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7a5d3e60-9f3f-40c0-9c96-097a006293e3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:06.510719 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7a5d3e60-9f3f-40c0-9c96-097a006293e3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:06.511182 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7a5d3e60-9f3f-40c0-9c96-097a006293e3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:06.515260 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-24b51047-f425-4ec0-b76b-ac2703ecc293 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:06.526417 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-24b51047-f425-4ec0-b76b-ac2703ecc293 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1093 microversion: 2.1 time: 0.074103 Sep 23 14:04:06.527180 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 109/205] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:06 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:06.533836 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3f0fede5-cd93-424b-829e-e12fcfd971f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:06.534490 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3f0fede5-cd93-424b-829e-e12fcfd971f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:06.541137 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f0fede5-cd93-424b-829e-e12fcfd971f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:06.541916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f0fede5-cd93-424b-829e-e12fcfd971f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:06.542566 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f0fede5-cd93-424b-829e-e12fcfd971f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:06.543310 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f0fede5-cd93-424b-829e-e12fcfd971f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:06.543862 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f0fede5-cd93-424b-829e-e12fcfd971f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:06.544452 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f0fede5-cd93-424b-829e-e12fcfd971f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:06.719189 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7a5d3e60-9f3f-40c0-9c96-097a006293e3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:06.739469 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3f0fede5-cd93-424b-829e-e12fcfd971f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:06.739644 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7a5d3e60-9f3f-40c0-9c96-097a006293e3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1510 microversion: 2.1 time: 0.230766 Sep 23 14:04:06.739644 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 97/206] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:06 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:06.739800 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3f0fede5-cd93-424b-829e-e12fcfd971f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:06.739800 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3f0fede5-cd93-424b-829e-e12fcfd971f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:06.739800 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3f0fede5-cd93-424b-829e-e12fcfd971f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1407 microversion: 2.20 time: 0.208532 Sep 23 14:04:06.740029 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 110/207] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:06 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:04:07.298737 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-895708bc-02d9-497a-8ebc-d3dd5b9c74b8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:07.299269 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-895708bc-02d9-497a-8ebc-d3dd5b9c74b8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:07.305599 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-895708bc-02d9-497a-8ebc-d3dd5b9c74b8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:07.306101 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-895708bc-02d9-497a-8ebc-d3dd5b9c74b8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:07.306582 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-895708bc-02d9-497a-8ebc-d3dd5b9c74b8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:07.307273 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-895708bc-02d9-497a-8ebc-d3dd5b9c74b8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:07.307734 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-895708bc-02d9-497a-8ebc-d3dd5b9c74b8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:07.311056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-895708bc-02d9-497a-8ebc-d3dd5b9c74b8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:07.373205 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-895708bc-02d9-497a-8ebc-d3dd5b9c74b8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:07.381054 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-895708bc-02d9-497a-8ebc-d3dd5b9c74b8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1244 microversion: 2.1 time: 0.086528 Sep 23 14:04:07.381625 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 98/208] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:07 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:07.549410 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-33117c7e-4b75-4091-b2a3-e7333ac9aa51 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:07.549943 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-33117c7e-4b75-4091-b2a3-e7333ac9aa51 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:07.604172 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-33117c7e-4b75-4091-b2a3-e7333ac9aa51 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:07.611649 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-33117c7e-4b75-4091-b2a3-e7333ac9aa51 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1093 microversion: 2.1 time: 0.066483 Sep 23 14:04:07.612217 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 111/209] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:07 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:07.751024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-64ddae1c-0d5e-4f7c-a825-b7ab5205ea25 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:07.751629 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-64ddae1c-0d5e-4f7c-a825-b7ab5205ea25 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:07.757504 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-64ddae1c-0d5e-4f7c-a825-b7ab5205ea25 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:07.757993 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-64ddae1c-0d5e-4f7c-a825-b7ab5205ea25 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:07.758478 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-64ddae1c-0d5e-4f7c-a825-b7ab5205ea25 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:07.759168 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-64ddae1c-0d5e-4f7c-a825-b7ab5205ea25 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:07.759627 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-64ddae1c-0d5e-4f7c-a825-b7ab5205ea25 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:07.760056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-64ddae1c-0d5e-4f7c-a825-b7ab5205ea25 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:07.761053 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-62a1aa00-38df-4eb8-8c22-54c6c32f97dc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:07.761669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-62a1aa00-38df-4eb8-8c22-54c6c32f97dc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:07.768714 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-62a1aa00-38df-4eb8-8c22-54c6c32f97dc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:07.769196 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-62a1aa00-38df-4eb8-8c22-54c6c32f97dc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:07.769639 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-62a1aa00-38df-4eb8-8c22-54c6c32f97dc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:07.770358 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-62a1aa00-38df-4eb8-8c22-54c6c32f97dc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:07.770816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-62a1aa00-38df-4eb8-8c22-54c6c32f97dc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:07.771244 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-62a1aa00-38df-4eb8-8c22-54c6c32f97dc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:07.954552 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-64ddae1c-0d5e-4f7c-a825-b7ab5205ea25 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:07.957470 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-62a1aa00-38df-4eb8-8c22-54c6c32f97dc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:07.962422 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-64ddae1c-0d5e-4f7c-a825-b7ab5205ea25 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1510 microversion: 2.1 time: 0.216019 Sep 23 14:04:07.962977 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 99/210] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:07 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:07.965520 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-62a1aa00-38df-4eb8-8c22-54c6c32f97dc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:07.967140 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-62a1aa00-38df-4eb8-8c22-54c6c32f97dc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:07.968247 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-62a1aa00-38df-4eb8-8c22-54c6c32f97dc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1407 microversion: 2.20 time: 0.211184 Sep 23 14:04:07.968792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 112/211] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:07 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:04:08.405939 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d424ba8d-019d-43a3-85c8-7c0f873acc1d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:08.406652 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d424ba8d-019d-43a3-85c8-7c0f873acc1d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:08.413146 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d424ba8d-019d-43a3-85c8-7c0f873acc1d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:08.413629 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d424ba8d-019d-43a3-85c8-7c0f873acc1d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:08.414095 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d424ba8d-019d-43a3-85c8-7c0f873acc1d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:08.414808 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d424ba8d-019d-43a3-85c8-7c0f873acc1d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:08.415432 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d424ba8d-019d-43a3-85c8-7c0f873acc1d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:08.416077 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d424ba8d-019d-43a3-85c8-7c0f873acc1d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:08.499104 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d424ba8d-019d-43a3-85c8-7c0f873acc1d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:08.507061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d424ba8d-019d-43a3-85c8-7c0f873acc1d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1236 microversion: 2.1 time: 0.105968 Sep 23 14:04:08.507710 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 100/212] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:08 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1236 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:08.634141 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d15cf8d6-e16c-4c9a-922e-20262ebab140 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:08.634782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d15cf8d6-e16c-4c9a-922e-20262ebab140 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:08.642097 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d15cf8d6-e16c-4c9a-922e-20262ebab140 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:08.642620 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d15cf8d6-e16c-4c9a-922e-20262ebab140 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:08.643058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d15cf8d6-e16c-4c9a-922e-20262ebab140 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:08.643743 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d15cf8d6-e16c-4c9a-922e-20262ebab140 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:08.644409 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d15cf8d6-e16c-4c9a-922e-20262ebab140 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:08.653131 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d15cf8d6-e16c-4c9a-922e-20262ebab140 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:08.760103 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d15cf8d6-e16c-4c9a-922e-20262ebab140 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:08.767958 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d15cf8d6-e16c-4c9a-922e-20262ebab140 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1135 microversion: 2.1 time: 0.137774 Sep 23 14:04:08.768523 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 113/213] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:08 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1135 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:08.985843 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1496e4f7-9f0c-4d26-9833-26dde918055e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:08.986489 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1496e4f7-9f0c-4d26-9833-26dde918055e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:08.992404 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1496e4f7-9f0c-4d26-9833-26dde918055e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:08.992815 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e01ca4e6-7fed-47eb-a98b-fbbd33e1ac20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:08.992954 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1496e4f7-9f0c-4d26-9833-26dde918055e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:08.993314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1496e4f7-9f0c-4d26-9833-26dde918055e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:08.993419 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e01ca4e6-7fed-47eb-a98b-fbbd33e1ac20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:08.994003 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1496e4f7-9f0c-4d26-9833-26dde918055e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:08.994495 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1496e4f7-9f0c-4d26-9833-26dde918055e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:08.994930 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1496e4f7-9f0c-4d26-9833-26dde918055e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:08.999247 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e01ca4e6-7fed-47eb-a98b-fbbd33e1ac20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:08.999728 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e01ca4e6-7fed-47eb-a98b-fbbd33e1ac20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:09.000162 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e01ca4e6-7fed-47eb-a98b-fbbd33e1ac20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:09.000839 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e01ca4e6-7fed-47eb-a98b-fbbd33e1ac20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:09.001288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e01ca4e6-7fed-47eb-a98b-fbbd33e1ac20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:09.001708 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e01ca4e6-7fed-47eb-a98b-fbbd33e1ac20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:09.009928 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:09.185715 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-1496e4f7-9f0c-4d26-9833-26dde918055e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:09.192536 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e01ca4e6-7fed-47eb-a98b-fbbd33e1ac20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:09.193372 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1496e4f7-9f0c-4d26-9833-26dde918055e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1510 microversion: 2.1 time: 0.211915 Sep 23 14:04:09.193952 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 101/214] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:08 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:09.201123 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e01ca4e6-7fed-47eb-a98b-fbbd33e1ac20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:09.202589 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e01ca4e6-7fed-47eb-a98b-fbbd33e1ac20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:09.203697 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e01ca4e6-7fed-47eb-a98b-fbbd33e1ac20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1407 microversion: 2.20 time: 0.214817 Sep 23 14:04:09.204749 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 114/215] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:08 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:04:09.537635 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fd1b8656-8be1-403a-9fc2-d1909432e3a5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:09.538260 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-fd1b8656-8be1-403a-9fc2-d1909432e3a5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:09.544581 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd1b8656-8be1-403a-9fc2-d1909432e3a5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:09.545363 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd1b8656-8be1-403a-9fc2-d1909432e3a5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:09.545804 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd1b8656-8be1-403a-9fc2-d1909432e3a5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:09.546536 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd1b8656-8be1-403a-9fc2-d1909432e3a5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:09.546997 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd1b8656-8be1-403a-9fc2-d1909432e3a5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:09.547456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd1b8656-8be1-403a-9fc2-d1909432e3a5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:09.611974 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fd1b8656-8be1-403a-9fc2-d1909432e3a5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:09.619537 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fd1b8656-8be1-403a-9fc2-d1909432e3a5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1292 microversion: 2.1 time: 0.085747 Sep 23 14:04:09.620095 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 102/216] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:09 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:09.789934 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5d4589cc-8e83-48db-a1e3-6baab1a34f52 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:09.790499 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5d4589cc-8e83-48db-a1e3-6baab1a34f52 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:09.797722 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5d4589cc-8e83-48db-a1e3-6baab1a34f52 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:09.798215 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5d4589cc-8e83-48db-a1e3-6baab1a34f52 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:09.798679 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5d4589cc-8e83-48db-a1e3-6baab1a34f52 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:09.799375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5d4589cc-8e83-48db-a1e3-6baab1a34f52 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:09.799839 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5d4589cc-8e83-48db-a1e3-6baab1a34f52 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:09.800266 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5d4589cc-8e83-48db-a1e3-6baab1a34f52 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:09.882692 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5d4589cc-8e83-48db-a1e3-6baab1a34f52 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:09.891669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5d4589cc-8e83-48db-a1e3-6baab1a34f52 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1135 microversion: 2.1 time: 0.105616 Sep 23 14:04:09.892427 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 115/217] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:09 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1135 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:10.215694 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-01e83031-ef3d-4d9d-9c95-d69850a17e53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:10.216331 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-01e83031-ef3d-4d9d-9c95-d69850a17e53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:10.222352 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-01e83031-ef3d-4d9d-9c95-d69850a17e53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:10.222852 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-01e83031-ef3d-4d9d-9c95-d69850a17e53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:10.223282 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-01e83031-ef3d-4d9d-9c95-d69850a17e53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:10.223970 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-01e83031-ef3d-4d9d-9c95-d69850a17e53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:10.224419 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-01e83031-ef3d-4d9d-9c95-d69850a17e53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:10.224839 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-01e83031-ef3d-4d9d-9c95-d69850a17e53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:10.228915 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f6109c5a-9b91-4b0d-a7f2-2431167fe53e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:10.229537 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f6109c5a-9b91-4b0d-a7f2-2431167fe53e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:10.236123 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f6109c5a-9b91-4b0d-a7f2-2431167fe53e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:10.236649 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f6109c5a-9b91-4b0d-a7f2-2431167fe53e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:10.237159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f6109c5a-9b91-4b0d-a7f2-2431167fe53e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:10.237881 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f6109c5a-9b91-4b0d-a7f2-2431167fe53e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:10.238352 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f6109c5a-9b91-4b0d-a7f2-2431167fe53e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:10.238795 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f6109c5a-9b91-4b0d-a7f2-2431167fe53e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:10.424910 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-01e83031-ef3d-4d9d-9c95-d69850a17e53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:10.431756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f6109c5a-9b91-4b0d-a7f2-2431167fe53e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:10.432655 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-01e83031-ef3d-4d9d-9c95-d69850a17e53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1510 microversion: 2.1 time: 0.220804 Sep 23 14:04:10.433238 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 103/218] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:10 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:10.440671 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f6109c5a-9b91-4b0d-a7f2-2431167fe53e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:10.442103 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f6109c5a-9b91-4b0d-a7f2-2431167fe53e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:10.443273 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f6109c5a-9b91-4b0d-a7f2-2431167fe53e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1407 microversion: 2.20 time: 0.218526 Sep 23 14:04:10.450820 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 116/219] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:10 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:04:10.642603 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7e2c01e1-17e0-4299-bcb2-aac8437582b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:10.643152 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7e2c01e1-17e0-4299-bcb2-aac8437582b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:10.648969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7e2c01e1-17e0-4299-bcb2-aac8437582b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:10.653415 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7e2c01e1-17e0-4299-bcb2-aac8437582b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:10.653415 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7e2c01e1-17e0-4299-bcb2-aac8437582b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:10.653415 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7e2c01e1-17e0-4299-bcb2-aac8437582b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:10.653415 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7e2c01e1-17e0-4299-bcb2-aac8437582b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:10.653812 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7e2c01e1-17e0-4299-bcb2-aac8437582b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:10.714280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7e2c01e1-17e0-4299-bcb2-aac8437582b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:10.722409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7e2c01e1-17e0-4299-bcb2-aac8437582b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1292 microversion: 2.1 time: 0.083873 Sep 23 14:04:10.722983 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 104/220] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:10 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:10.914731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4f7e9803-e0ae-4277-b2bc-d5c8c8c7ea6e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:10.915261 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4f7e9803-e0ae-4277-b2bc-d5c8c8c7ea6e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:10.922119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4f7e9803-e0ae-4277-b2bc-d5c8c8c7ea6e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:10.922634 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4f7e9803-e0ae-4277-b2bc-d5c8c8c7ea6e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:10.923066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4f7e9803-e0ae-4277-b2bc-d5c8c8c7ea6e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:10.923743 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4f7e9803-e0ae-4277-b2bc-d5c8c8c7ea6e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:10.924197 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4f7e9803-e0ae-4277-b2bc-d5c8c8c7ea6e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:10.924619 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4f7e9803-e0ae-4277-b2bc-d5c8c8c7ea6e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:10.984545 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4f7e9803-e0ae-4277-b2bc-d5c8c8c7ea6e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:10.992094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4f7e9803-e0ae-4277-b2bc-d5c8c8c7ea6e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1135 microversion: 2.1 time: 0.081464 Sep 23 14:04:10.992651 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 117/221] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:10 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1135 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:11.458259 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-efaaad29-e162-42bc-9b63-e1e01e73c2c7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:11.458259 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-efaaad29-e162-42bc-9b63-e1e01e73c2c7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:11.462933 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-efaaad29-e162-42bc-9b63-e1e01e73c2c7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:11.463421 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-efaaad29-e162-42bc-9b63-e1e01e73c2c7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:11.463859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-efaaad29-e162-42bc-9b63-e1e01e73c2c7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:11.464550 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-efaaad29-e162-42bc-9b63-e1e01e73c2c7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:11.465006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-efaaad29-e162-42bc-9b63-e1e01e73c2c7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:11.465467 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-efaaad29-e162-42bc-9b63-e1e01e73c2c7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:11.475583 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3f3299aa-a9ac-40d8-bd12-93c010221fed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:11.475583 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3f3299aa-a9ac-40d8-bd12-93c010221fed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:11.480336 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f3299aa-a9ac-40d8-bd12-93c010221fed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:11.481408 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f3299aa-a9ac-40d8-bd12-93c010221fed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:11.481856 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f3299aa-a9ac-40d8-bd12-93c010221fed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:11.482586 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f3299aa-a9ac-40d8-bd12-93c010221fed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:11.483050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f3299aa-a9ac-40d8-bd12-93c010221fed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:11.483477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f3299aa-a9ac-40d8-bd12-93c010221fed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:11.682625 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3f3299aa-a9ac-40d8-bd12-93c010221fed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:11.691210 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-efaaad29-e162-42bc-9b63-e1e01e73c2c7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:11.693832 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3f3299aa-a9ac-40d8-bd12-93c010221fed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:11.697203 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3f3299aa-a9ac-40d8-bd12-93c010221fed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:11.698859 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3f3299aa-a9ac-40d8-bd12-93c010221fed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1407 microversion: 2.20 time: 0.229349 Sep 23 14:04:11.699610 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 118/222] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:11 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:04:11.710039 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-efaaad29-e162-42bc-9b63-e1e01e73c2c7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1510 microversion: 2.1 time: 0.251837 Sep 23 14:04:11.710039 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 105/223] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:11 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:11.745259 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-457f0081-e803-4515-a7f7-44fc2331a9ca tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:11.745963 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-457f0081-e803-4515-a7f7-44fc2331a9ca tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:11.752795 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-457f0081-e803-4515-a7f7-44fc2331a9ca tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:11.753267 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-457f0081-e803-4515-a7f7-44fc2331a9ca tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:11.753704 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-457f0081-e803-4515-a7f7-44fc2331a9ca tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:11.754417 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-457f0081-e803-4515-a7f7-44fc2331a9ca tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:11.754876 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-457f0081-e803-4515-a7f7-44fc2331a9ca tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:11.755303 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-457f0081-e803-4515-a7f7-44fc2331a9ca tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:11.825031 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-457f0081-e803-4515-a7f7-44fc2331a9ca tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:11.832775 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-457f0081-e803-4515-a7f7-44fc2331a9ca tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1292 microversion: 2.1 time: 0.091441 Sep 23 14:04:11.833331 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 119/224] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:11 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:12.015221 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-51998ecb-dd3a-4ac1-82dd-f576ac43b4c2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:12.015840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-51998ecb-dd3a-4ac1-82dd-f576ac43b4c2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:12.021638 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-51998ecb-dd3a-4ac1-82dd-f576ac43b4c2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:12.022132 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-51998ecb-dd3a-4ac1-82dd-f576ac43b4c2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:12.022607 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-51998ecb-dd3a-4ac1-82dd-f576ac43b4c2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:12.025062 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-51998ecb-dd3a-4ac1-82dd-f576ac43b4c2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:12.025062 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-51998ecb-dd3a-4ac1-82dd-f576ac43b4c2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:12.025062 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-51998ecb-dd3a-4ac1-82dd-f576ac43b4c2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:12.086251 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-51998ecb-dd3a-4ac1-82dd-f576ac43b4c2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:12.095261 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-51998ecb-dd3a-4ac1-82dd-f576ac43b4c2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1191 microversion: 2.1 time: 0.084604 Sep 23 14:04:12.095837 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 106/225] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:12 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:12.724599 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-39ded17c-00ed-435c-a963-705a2f7eaf95 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:12.725694 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-39ded17c-00ed-435c-a963-705a2f7eaf95 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:12.729943 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e323efcd-351a-4378-b8d5-0d401f9cd944 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:12.731902 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e323efcd-351a-4378-b8d5-0d401f9cd944 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:12.739198 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e323efcd-351a-4378-b8d5-0d401f9cd944 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:12.740843 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e323efcd-351a-4378-b8d5-0d401f9cd944 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:12.741514 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e323efcd-351a-4378-b8d5-0d401f9cd944 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:12.742462 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e323efcd-351a-4378-b8d5-0d401f9cd944 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:12.743074 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e323efcd-351a-4378-b8d5-0d401f9cd944 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:12.747025 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e323efcd-351a-4378-b8d5-0d401f9cd944 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:12.750664 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39ded17c-00ed-435c-a963-705a2f7eaf95 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:12.751202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39ded17c-00ed-435c-a963-705a2f7eaf95 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:12.751661 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39ded17c-00ed-435c-a963-705a2f7eaf95 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:12.752407 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39ded17c-00ed-435c-a963-705a2f7eaf95 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:12.752885 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39ded17c-00ed-435c-a963-705a2f7eaf95 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:12.754025 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39ded17c-00ed-435c-a963-705a2f7eaf95 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:13.032914 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e323efcd-351a-4378-b8d5-0d401f9cd944 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:13.040769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e323efcd-351a-4378-b8d5-0d401f9cd944 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1516 microversion: 2.1 time: 0.315790 Sep 23 14:04:13.041357 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 107/226] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:12 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:13.046606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-43a77cb5-1992-4521-a81b-6b7997ffcb7f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:13.047213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-43a77cb5-1992-4521-a81b-6b7997ffcb7f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:13.049146 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:13.053540 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-39ded17c-00ed-435c-a963-705a2f7eaf95 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:13.054138 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43a77cb5-1992-4521-a81b-6b7997ffcb7f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:13.054960 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43a77cb5-1992-4521-a81b-6b7997ffcb7f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:13.055706 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43a77cb5-1992-4521-a81b-6b7997ffcb7f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:13.056587 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43a77cb5-1992-4521-a81b-6b7997ffcb7f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:13.057051 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43a77cb5-1992-4521-a81b-6b7997ffcb7f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:13.057476 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43a77cb5-1992-4521-a81b-6b7997ffcb7f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:13.060979 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=100 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:13.069857 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-39ded17c-00ed-435c-a963-705a2f7eaf95 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:13.073879 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-39ded17c-00ed-435c-a963-705a2f7eaf95 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:13.073879 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-39ded17c-00ed-435c-a963-705a2f7eaf95 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1407 microversion: 2.20 time: 0.351888 Sep 23 14:04:13.073879 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 120/227] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:12 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:04:13.118642 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a6e8fb20-5c3c-4668-8b32-72f9f5bc81d1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:13.119431 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a6e8fb20-5c3c-4668-8b32-72f9f5bc81d1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:13.131057 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6e8fb20-5c3c-4668-8b32-72f9f5bc81d1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:13.131390 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6e8fb20-5c3c-4668-8b32-72f9f5bc81d1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:13.131815 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6e8fb20-5c3c-4668-8b32-72f9f5bc81d1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:13.132599 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6e8fb20-5c3c-4668-8b32-72f9f5bc81d1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:13.133653 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6e8fb20-5c3c-4668-8b32-72f9f5bc81d1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:13.134098 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6e8fb20-5c3c-4668-8b32-72f9f5bc81d1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:13.185197 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-43a77cb5-1992-4521-a81b-6b7997ffcb7f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:13.193505 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-43a77cb5-1992-4521-a81b-6b7997ffcb7f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1298 microversion: 2.1 time: 0.151128 Sep 23 14:04:13.194082 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 108/228] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:13 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1298 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:13.239206 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a6e8fb20-5c3c-4668-8b32-72f9f5bc81d1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:13.247575 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a6e8fb20-5c3c-4668-8b32-72f9f5bc81d1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1191 microversion: 2.1 time: 0.133442 Sep 23 14:04:13.248141 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 121/229] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:13 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1191 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:13.673709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-c10644b9-e6cb-4cac-b3f4-086e2d98b059 req-4d06dcfb-c0a4-48b6-abed-0db6bfc379cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97557fbe-c1f4-464e-93b8-3c71fbc48936", "name": "network-vif-plugged", "status": "completed", "tag": "0765d95c-b5b8-4eb9-aef1-96129a9a206d"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:13.693984 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-c10644b9-e6cb-4cac-b3f4-086e2d98b059 req-4d06dcfb-c0a4-48b6-abed-0db6bfc379cb service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:13.694654 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-c10644b9-e6cb-4cac-b3f4-086e2d98b059 req-4d06dcfb-c0a4-48b6-abed-0db6bfc379cb service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:13.695258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-c10644b9-e6cb-4cac-b3f4-086e2d98b059 req-4d06dcfb-c0a4-48b6-abed-0db6bfc379cb service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:13.735919 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=4 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:13.739255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-c10644b9-e6cb-4cac-b3f4-086e2d98b059 req-4d06dcfb-c0a4-48b6-abed-0db6bfc379cb service nova] Creating event network-vif-plugged:0765d95c-b5b8-4eb9-aef1-96129a9a206d for instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 on hv-cinder-85743 Sep 23 14:04:13.758280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-c10644b9-e6cb-4cac-b3f4-086e2d98b059 req-4d06dcfb-c0a4-48b6-abed-0db6bfc379cb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106801 Sep 23 14:04:13.761427 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 109/230] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:04:14.097921 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-98affd61-7c5b-4b37-8174-3f7a89e06655 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:14.099219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-98affd61-7c5b-4b37-8174-3f7a89e06655 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:14.106118 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-98affd61-7c5b-4b37-8174-3f7a89e06655 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:14.107132 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-98affd61-7c5b-4b37-8174-3f7a89e06655 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:14.107806 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-98affd61-7c5b-4b37-8174-3f7a89e06655 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:14.108777 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-98affd61-7c5b-4b37-8174-3f7a89e06655 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:14.109451 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-98affd61-7c5b-4b37-8174-3f7a89e06655 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:14.110088 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-98affd61-7c5b-4b37-8174-3f7a89e06655 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:14.218275 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-92baff2c-82de-4ab3-b8fa-c3242510f920 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:14.218999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-92baff2c-82de-4ab3-b8fa-c3242510f920 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:14.220958 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=12 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:14.226754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-92baff2c-82de-4ab3-b8fa-c3242510f920 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:14.227542 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-92baff2c-82de-4ab3-b8fa-c3242510f920 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:14.228239 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-92baff2c-82de-4ab3-b8fa-c3242510f920 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:14.229180 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-92baff2c-82de-4ab3-b8fa-c3242510f920 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:14.229846 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-92baff2c-82de-4ab3-b8fa-c3242510f920 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:14.230683 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-92baff2c-82de-4ab3-b8fa-c3242510f920 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:14.699196 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-98affd61-7c5b-4b37-8174-3f7a89e06655 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:14.717342 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-98affd61-7c5b-4b37-8174-3f7a89e06655 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:14.718814 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-98affd61-7c5b-4b37-8174-3f7a89e06655 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:14.720140 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-98affd61-7c5b-4b37-8174-3f7a89e06655 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1407 microversion: 2.20 time: 0.626528 Sep 23 14:04:14.721358 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 122/231] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:14 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1407 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:04:14.726028 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a65a925a-cbee-47ae-8678-d51d454176b8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:14.726730 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a65a925a-cbee-47ae-8678-d51d454176b8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:14.733662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a65a925a-cbee-47ae-8678-d51d454176b8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:14.734360 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a65a925a-cbee-47ae-8678-d51d454176b8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:14.747631 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a65a925a-cbee-47ae-8678-d51d454176b8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:14.748414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a65a925a-cbee-47ae-8678-d51d454176b8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:14.748906 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a65a925a-cbee-47ae-8678-d51d454176b8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:14.749345 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a65a925a-cbee-47ae-8678-d51d454176b8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:14.768134 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-92baff2c-82de-4ab3-b8fa-c3242510f920 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:14.778809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-92baff2c-82de-4ab3-b8fa-c3242510f920 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1366 microversion: 2.1 time: 0.563791 Sep 23 14:04:14.791789 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 110/232] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:14 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:14.830093 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5f9ef0a7-bfea-4bb2-919f-d4f100af381a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Action: 'create', calling method: .version_select at 0x7f9083daba60>, body: {"keypair": {"name": "tempest-keypair-1044033894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZ19N8W+lE8DOku0ucw6AIR0l72mCaMBiOBt5Y2J01Uyzu5ybyjNnxBTz5Hzj9zieVRtADzFeOOWSSs8TPjaagIZPMtvjJgPnzQdPBtms1gydVgs/yTt6t6b/Cyz702Eg=="}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:14.841000 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a65a925a-cbee-47ae-8678-d51d454176b8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:14.848319 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-5f9ef0a7-bfea-4bb2-919f-d4f100af381a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Getting quotas for project d08a219027684089a91c354749c67d5d. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:04:14.849591 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a65a925a-cbee-47ae-8678-d51d454176b8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1209 microversion: 2.1 time: 0.126939 Sep 23 14:04:14.853221 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 123/233] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:14 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1209 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:14.853327 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-5f9ef0a7-bfea-4bb2-919f-d4f100af381a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Getting quotas for user 28b64a35d7b44519a1d93919f2e23083 and project d08a219027684089a91c354749c67d5d. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:04:14.939806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5f9ef0a7-bfea-4bb2-919f-d4f100af381a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113838 Sep 23 14:04:14.940621 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 111/234] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 23 14:04:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:04:15.344477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-a77340b9-02b7-4901-9a15-5d0126ce3be1 req-9d8b8508-bfb2-48a5-85cb-b854b212e0ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760e9fcc-3723-43bd-ab9b-db54f81db1ae", "tag": "c01d1346-01d1-4da4-84a3-b81e410d1f69"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:15.365604 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-a77340b9-02b7-4901-9a15-5d0126ce3be1 req-9d8b8508-bfb2-48a5-85cb-b854b212e0ef service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:15.366093 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-a77340b9-02b7-4901-9a15-5d0126ce3be1 req-9d8b8508-bfb2-48a5-85cb-b854b212e0ef service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:15.367151 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-a77340b9-02b7-4901-9a15-5d0126ce3be1 req-9d8b8508-bfb2-48a5-85cb-b854b212e0ef service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:15.379308 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-a77340b9-02b7-4901-9a15-5d0126ce3be1 req-9d8b8508-bfb2-48a5-85cb-b854b212e0ef service nova] Creating event network-changed:c01d1346-01d1-4da4-84a3-b81e410d1f69 for instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae on hv-cinder-85743 Sep 23 14:04:15.384197 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-a77340b9-02b7-4901-9a15-5d0126ce3be1 req-9d8b8508-bfb2-48a5-85cb-b854b212e0ef service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044875 Sep 23 14:04:15.384863 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 124/235] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:04:15.748142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e48e537d-2e5b-4d59-9743-f2e680dc6c6e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:15.748748 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e48e537d-2e5b-4d59-9743-f2e680dc6c6e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:15.754877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e48e537d-2e5b-4d59-9743-f2e680dc6c6e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:15.755468 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e48e537d-2e5b-4d59-9743-f2e680dc6c6e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:15.755920 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e48e537d-2e5b-4d59-9743-f2e680dc6c6e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:15.756826 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e48e537d-2e5b-4d59-9743-f2e680dc6c6e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:15.757044 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e48e537d-2e5b-4d59-9743-f2e680dc6c6e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:15.757462 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e48e537d-2e5b-4d59-9743-f2e680dc6c6e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:15.804541 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-de156d40-20f8-492f-98e2-c433f6e3422a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:15.805252 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-de156d40-20f8-492f-98e2-c433f6e3422a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:15.811620 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-de156d40-20f8-492f-98e2-c433f6e3422a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:15.812109 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-de156d40-20f8-492f-98e2-c433f6e3422a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:15.812547 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-de156d40-20f8-492f-98e2-c433f6e3422a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:15.813239 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-de156d40-20f8-492f-98e2-c433f6e3422a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:15.813759 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-de156d40-20f8-492f-98e2-c433f6e3422a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:15.814221 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-de156d40-20f8-492f-98e2-c433f6e3422a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:15.893619 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:15.946567 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e48e537d-2e5b-4d59-9743-f2e680dc6c6e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:15.954995 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e48e537d-2e5b-4d59-9743-f2e680dc6c6e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:15.956418 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e48e537d-2e5b-4d59-9743-f2e680dc6c6e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:15.957639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e48e537d-2e5b-4d59-9743-f2e680dc6c6e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1407 microversion: 2.20 time: 0.213666 Sep 23 14:04:15.958461 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 112/236] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:15 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:04:15.963311 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-606a3a2a-fa23-49c4-99d4-29c4e28178b5 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:15.963910 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-606a3a2a-fa23-49c4-99d4-29c4e28178b5 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:15.970403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-606a3a2a-fa23-49c4-99d4-29c4e28178b5 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:15.970974 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-606a3a2a-fa23-49c4-99d4-29c4e28178b5 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:15.971461 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-606a3a2a-fa23-49c4-99d4-29c4e28178b5 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:15.972331 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-606a3a2a-fa23-49c4-99d4-29c4e28178b5 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:15.972936 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-606a3a2a-fa23-49c4-99d4-29c4e28178b5 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:15.974083 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-606a3a2a-fa23-49c4-99d4-29c4e28178b5 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:15.979409 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-de156d40-20f8-492f-98e2-c433f6e3422a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:15.994069 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-de156d40-20f8-492f-98e2-c433f6e3422a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1366 microversion: 2.1 time: 0.193842 Sep 23 14:04:15.995219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 125/237] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:15 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:16.107417 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-606a3a2a-fa23-49c4-99d4-29c4e28178b5 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:16.115333 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-606a3a2a-fa23-49c4-99d4-29c4e28178b5 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1276 microversion: 2.1 time: 0.155558 Sep 23 14:04:16.115899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 113/238] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:15 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:16.984875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9313b0fa-d8ce-43f3-9e9f-7ce7f2bf3ef7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:16.985487 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9313b0fa-d8ce-43f3-9e9f-7ce7f2bf3ef7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:16.992080 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9313b0fa-d8ce-43f3-9e9f-7ce7f2bf3ef7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:16.992572 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9313b0fa-d8ce-43f3-9e9f-7ce7f2bf3ef7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:16.993014 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9313b0fa-d8ce-43f3-9e9f-7ce7f2bf3ef7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:16.993710 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9313b0fa-d8ce-43f3-9e9f-7ce7f2bf3ef7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:16.994167 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9313b0fa-d8ce-43f3-9e9f-7ce7f2bf3ef7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:16.994699 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9313b0fa-d8ce-43f3-9e9f-7ce7f2bf3ef7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:17.018862 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0dc21b4c-7542-47c8-b063-1ee79f870420 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:17.019474 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-0dc21b4c-7542-47c8-b063-1ee79f870420 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:17.025749 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0dc21b4c-7542-47c8-b063-1ee79f870420 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:17.026376 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0dc21b4c-7542-47c8-b063-1ee79f870420 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:17.027009 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0dc21b4c-7542-47c8-b063-1ee79f870420 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:17.028924 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0dc21b4c-7542-47c8-b063-1ee79f870420 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:17.029323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0dc21b4c-7542-47c8-b063-1ee79f870420 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:17.029753 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0dc21b4c-7542-47c8-b063-1ee79f870420 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:17.219051 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9313b0fa-d8ce-43f3-9e9f-7ce7f2bf3ef7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:17.225600 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-0dc21b4c-7542-47c8-b063-1ee79f870420 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:17.227959 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9313b0fa-d8ce-43f3-9e9f-7ce7f2bf3ef7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:17.229415 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9313b0fa-d8ce-43f3-9e9f-7ce7f2bf3ef7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:17.230633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9313b0fa-d8ce-43f3-9e9f-7ce7f2bf3ef7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1407 microversion: 2.20 time: 0.249903 Sep 23 14:04:17.231304 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 126/239] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:16 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:04:17.234206 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-0dc21b4c-7542-47c8-b063-1ee79f870420 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1366 microversion: 2.1 time: 0.219592 Sep 23 14:04:17.234829 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 114/240] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:17 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:17.240602 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a5b03254-6689-4f96-a556-b2153041364a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:17.241413 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a5b03254-6689-4f96-a556-b2153041364a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:17.244744 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:17.249251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a5b03254-6689-4f96-a556-b2153041364a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:17.255234 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a5b03254-6689-4f96-a556-b2153041364a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:17.255234 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a5b03254-6689-4f96-a556-b2153041364a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:17.255234 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a5b03254-6689-4f96-a556-b2153041364a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:17.255234 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a5b03254-6689-4f96-a556-b2153041364a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:17.255571 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a5b03254-6689-4f96-a556-b2153041364a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:17.390548 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a5b03254-6689-4f96-a556-b2153041364a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:17.398195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a5b03254-6689-4f96-a556-b2153041364a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1276 microversion: 2.1 time: 0.162303 Sep 23 14:04:17.403191 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 127/241] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:17 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:17.423603 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-33086849", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35b1eec9-f37f-4a15-9846-f6e35c1c3a12"}], "security_groups": [{"name": "tempest-securitygroup--1449068859"}], "key_name": "tempest-keypair-1044033894", "user_data": "}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:17.553489 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.network.neutron [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] validate_networks() for [('35b1eec9-f37f-4a15-9846-f6e35c1c3a12', None, None, None, None, None)] {{(pid=121074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:04:18.024362 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Flavor limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:04:18.024964 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Image limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:04:18.025407 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Flavor pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:04:18.025900 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Image pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:04:18.026424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:04:18.035243 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:18.035726 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:18.036160 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:18.036883 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:18.037337 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:18.038120 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:18.055144 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Getting quotas for project d08a219027684089a91c354749c67d5d. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:04:18.059667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Getting quotas for user 28b64a35d7b44519a1d93919f2e23083 and project d08a219027684089a91c354749c67d5d. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:04:18.071406 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Going to run 1 instances... {{(pid=121074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:04:18.073648 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:04:18.216785 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a56163a9-c043-43a3-991c-e63f13998a48 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.797011 Sep 23 14:04:18.217316 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 115/242] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:04:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 14:04:18.229046 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-cc135266-110d-42ab-9ba0-d83892e4d542 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:18.229440 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-cc135266-110d-42ab-9ba0-d83892e4d542 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:18.232956 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=18 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:18.257174 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b810ffb6-7cf6-4ed5-9d53-bb513753a4be tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:18.258030 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b810ffb6-7cf6-4ed5-9d53-bb513753a4be tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:18.265275 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b810ffb6-7cf6-4ed5-9d53-bb513753a4be tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:18.265994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b810ffb6-7cf6-4ed5-9d53-bb513753a4be tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:18.266630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b810ffb6-7cf6-4ed5-9d53-bb513753a4be tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:18.267334 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b810ffb6-7cf6-4ed5-9d53-bb513753a4be tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:18.267941 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b810ffb6-7cf6-4ed5-9d53-bb513753a4be tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:18.268518 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b810ffb6-7cf6-4ed5-9d53-bb513753a4be tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:18.295325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-cc135266-110d-42ab-9ba0-d83892e4d542 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:18.338374 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-cc135266-110d-42ab-9ba0-d83892e4d542 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1244 microversion: 2.1 time: 0.113685 Sep 23 14:04:18.341438 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 128/243] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:18 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1244 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:18.350897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-0a323f5b-d378-41be-aa26-3eb494bfc4c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:18.353727 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-0a323f5b-d378-41be-aa26-3eb494bfc4c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:18.365833 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a323f5b-d378-41be-aa26-3eb494bfc4c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:18.366745 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a323f5b-d378-41be-aa26-3eb494bfc4c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:18.367278 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a323f5b-d378-41be-aa26-3eb494bfc4c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:18.368056 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a323f5b-d378-41be-aa26-3eb494bfc4c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:18.368584 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a323f5b-d378-41be-aa26-3eb494bfc4c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:18.369080 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a323f5b-d378-41be-aa26-3eb494bfc4c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:18.592150 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b810ffb6-7cf6-4ed5-9d53-bb513753a4be tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:18.602929 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b810ffb6-7cf6-4ed5-9d53-bb513753a4be tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1366 microversion: 2.1 time: 0.349440 Sep 23 14:04:18.609535 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 116/244] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:18 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:18.618968 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-df3c4ee1-fe29-4271-ad29-607a9ccbbd02 req-0c9adaa4-7d39-40ac-ac04-6f98413951d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a131c7-2478-421b-86df-633cca15c7b7", "tag": "894a169a-68e6-48c8-88fa-1d068254a466"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:18.636094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-0a323f5b-d378-41be-aa26-3eb494bfc4c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:18.646813 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-df3c4ee1-fe29-4271-ad29-607a9ccbbd02 req-0c9adaa4-7d39-40ac-ac04-6f98413951d6 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:18.647301 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-df3c4ee1-fe29-4271-ad29-607a9ccbbd02 req-0c9adaa4-7d39-40ac-ac04-6f98413951d6 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:18.647739 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-df3c4ee1-fe29-4271-ad29-607a9ccbbd02 req-0c9adaa4-7d39-40ac-ac04-6f98413951d6 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:18.648562 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-0a323f5b-d378-41be-aa26-3eb494bfc4c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:18.670038 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-df3c4ee1-fe29-4271-ad29-607a9ccbbd02 req-0c9adaa4-7d39-40ac-ac04-6f98413951d6 service nova] Creating event network-changed:894a169a-68e6-48c8-88fa-1d068254a466 for instance 51a131c7-2478-421b-86df-633cca15c7b7 on hv-cinder-85743 Sep 23 14:04:18.670302 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-0a323f5b-d378-41be-aa26-3eb494bfc4c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:18.671559 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-0a323f5b-d378-41be-aa26-3eb494bfc4c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1407 microversion: 2.20 time: 0.328271 Sep 23 14:04:18.672406 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 129/245] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:18 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:04:18.680243 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-94761811-1437-482c-999f-e691bc6ad22d tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:18.680942 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-94761811-1437-482c-999f-e691bc6ad22d tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:18.687481 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94761811-1437-482c-999f-e691bc6ad22d tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:18.687985 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94761811-1437-482c-999f-e691bc6ad22d tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:18.688411 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94761811-1437-482c-999f-e691bc6ad22d tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:18.689102 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94761811-1437-482c-999f-e691bc6ad22d tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:18.689645 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94761811-1437-482c-999f-e691bc6ad22d tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:18.690067 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94761811-1437-482c-999f-e691bc6ad22d tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:18.694134 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-df3c4ee1-fe29-4271-ad29-607a9ccbbd02 req-0c9adaa4-7d39-40ac-ac04-6f98413951d6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083169 Sep 23 14:04:18.694764 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 117/246] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:04:18.832856 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-94761811-1437-482c-999f-e691bc6ad22d tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:18.841531 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-94761811-1437-482c-999f-e691bc6ad22d tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1276 microversion: 2.1 time: 0.164967 Sep 23 14:04:18.843198 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 130/247] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:18 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:19.394348 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e7408543-7d4f-49e6-80b4-b59cfe6dc6bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:19.394348 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e7408543-7d4f-49e6-80b4-b59cfe6dc6bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:19.426261 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e7408543-7d4f-49e6-80b4-b59cfe6dc6bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:19.435646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e7408543-7d4f-49e6-80b4-b59cfe6dc6bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1244 microversion: 2.1 time: 0.074997 Sep 23 14:04:19.436723 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 118/248] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:19 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1244 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:19.632925 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b1e7e74d-f193-4c98-9112-7325179b38fa tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:19.633665 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b1e7e74d-f193-4c98-9112-7325179b38fa tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:19.642002 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b1e7e74d-f193-4c98-9112-7325179b38fa tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:19.642002 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b1e7e74d-f193-4c98-9112-7325179b38fa tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:19.642002 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b1e7e74d-f193-4c98-9112-7325179b38fa tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:19.642500 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b1e7e74d-f193-4c98-9112-7325179b38fa tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:19.642956 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b1e7e74d-f193-4c98-9112-7325179b38fa tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:19.643378 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b1e7e74d-f193-4c98-9112-7325179b38fa tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:19.702833 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f07f2603-e2f3-4211-bf2a-7feff3d195e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:19.703854 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f07f2603-e2f3-4211-bf2a-7feff3d195e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:19.710990 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f07f2603-e2f3-4211-bf2a-7feff3d195e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:19.711753 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f07f2603-e2f3-4211-bf2a-7feff3d195e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:19.712347 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f07f2603-e2f3-4211-bf2a-7feff3d195e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:19.713201 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f07f2603-e2f3-4211-bf2a-7feff3d195e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:19.713803 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f07f2603-e2f3-4211-bf2a-7feff3d195e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:19.715064 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f07f2603-e2f3-4211-bf2a-7feff3d195e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:19.979633 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f07f2603-e2f3-4211-bf2a-7feff3d195e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:19.984228 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b1e7e74d-f193-4c98-9112-7325179b38fa tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:20.000023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b1e7e74d-f193-4c98-9112-7325179b38fa tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1366 microversion: 2.1 time: 0.370686 Sep 23 14:04:20.001301 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 131/249] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:19 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:20.004051 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f07f2603-e2f3-4211-bf2a-7feff3d195e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:20.005932 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f07f2603-e2f3-4211-bf2a-7feff3d195e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:20.007122 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-abc6ef44-5ea0-4519-ad94-700d1c196cd1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:20.007617 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f07f2603-e2f3-4211-bf2a-7feff3d195e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1600 microversion: 2.20 time: 0.312739 Sep 23 14:04:20.007773 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-abc6ef44-5ea0-4519-ad94-700d1c196cd1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:20.022352 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 119/250] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:04:19 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1600 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:04:20.033967 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-abc6ef44-5ea0-4519-ad94-700d1c196cd1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:20.033967 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-abc6ef44-5ea0-4519-ad94-700d1c196cd1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:20.033967 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-abc6ef44-5ea0-4519-ad94-700d1c196cd1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:20.033967 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-abc6ef44-5ea0-4519-ad94-700d1c196cd1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:20.034377 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-abc6ef44-5ea0-4519-ad94-700d1c196cd1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:20.034377 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-abc6ef44-5ea0-4519-ad94-700d1c196cd1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:20.049701 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5e9f349f-e8a9-40f5-b171-32de0efb0b85 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:20.050216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-5e9f349f-e8a9-40f5-b171-32de0efb0b85 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:20.056281 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5e9f349f-e8a9-40f5-b171-32de0efb0b85 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:20.056798 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5e9f349f-e8a9-40f5-b171-32de0efb0b85 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:20.057245 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5e9f349f-e8a9-40f5-b171-32de0efb0b85 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:20.057942 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5e9f349f-e8a9-40f5-b171-32de0efb0b85 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:20.058952 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5e9f349f-e8a9-40f5-b171-32de0efb0b85 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:20.058952 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5e9f349f-e8a9-40f5-b171-32de0efb0b85 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:20.205987 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5e9f349f-e8a9-40f5-b171-32de0efb0b85 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.160136 Sep 23 14:04:20.206620 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 120/251] 10.222.0.62 () {60 vars in 1316 bytes} [Fri Sep 23 14:04:20 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 14:04:20.286084 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-abc6ef44-5ea0-4519-ad94-700d1c196cd1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:20.295165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-abc6ef44-5ea0-4519-ad94-700d1c196cd1 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1276 microversion: 2.1 time: 0.291766 Sep 23 14:04:20.298479 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 132/252] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:20 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1276 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:20.482948 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-76e4fd91-eefb-4611-9d56-6384ef79eb22 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:20.484313 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-76e4fd91-eefb-4611-9d56-6384ef79eb22 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:20.491864 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-76e4fd91-eefb-4611-9d56-6384ef79eb22 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:20.492391 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-76e4fd91-eefb-4611-9d56-6384ef79eb22 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:20.493078 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-76e4fd91-eefb-4611-9d56-6384ef79eb22 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:20.493975 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-76e4fd91-eefb-4611-9d56-6384ef79eb22 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:20.494616 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-76e4fd91-eefb-4611-9d56-6384ef79eb22 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:20.495039 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-76e4fd91-eefb-4611-9d56-6384ef79eb22 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:20.564326 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-76e4fd91-eefb-4611-9d56-6384ef79eb22 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:20.577467 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-76e4fd91-eefb-4611-9d56-6384ef79eb22 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1240 microversion: 2.1 time: 0.100610 Sep 23 14:04:20.578147 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 121/253] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:20 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:21.023642 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-52aa9166-eb2d-4b4d-ac93-71bc5242db59 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:21.024190 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-52aa9166-eb2d-4b4d-ac93-71bc5242db59 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:21.031617 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-52aa9166-eb2d-4b4d-ac93-71bc5242db59 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:21.032115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-52aa9166-eb2d-4b4d-ac93-71bc5242db59 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:21.032743 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-52aa9166-eb2d-4b4d-ac93-71bc5242db59 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:21.033452 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-52aa9166-eb2d-4b4d-ac93-71bc5242db59 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:21.033911 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-52aa9166-eb2d-4b4d-ac93-71bc5242db59 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:21.034349 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-52aa9166-eb2d-4b4d-ac93-71bc5242db59 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:21.179023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-52aa9166-eb2d-4b4d-ac93-71bc5242db59 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:21.187284 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-52aa9166-eb2d-4b4d-ac93-71bc5242db59 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1366 microversion: 2.1 time: 0.167719 Sep 23 14:04:21.187875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 133/254] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:21 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:21.319270 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-91f54de6-d019-4fc0-a297-095d022dec4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:21.319993 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-91f54de6-d019-4fc0-a297-095d022dec4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:21.326708 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-91f54de6-d019-4fc0-a297-095d022dec4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:21.330350 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-91f54de6-d019-4fc0-a297-095d022dec4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:21.330350 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-91f54de6-d019-4fc0-a297-095d022dec4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:21.330350 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-91f54de6-d019-4fc0-a297-095d022dec4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:21.330350 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-91f54de6-d019-4fc0-a297-095d022dec4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:21.330709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-91f54de6-d019-4fc0-a297-095d022dec4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:21.344732 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=100 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:21.467543 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-91f54de6-d019-4fc0-a297-095d022dec4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:21.475290 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-91f54de6-d019-4fc0-a297-095d022dec4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1264 microversion: 2.1 time: 0.159842 Sep 23 14:04:21.475862 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 122/255] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:21 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:21.602841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9d1bbbaa-b8bd-466a-8b8a-86f26a76ff61 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:21.603788 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9d1bbbaa-b8bd-466a-8b8a-86f26a76ff61 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:21.613929 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d1bbbaa-b8bd-466a-8b8a-86f26a76ff61 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:21.614449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d1bbbaa-b8bd-466a-8b8a-86f26a76ff61 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:21.615059 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d1bbbaa-b8bd-466a-8b8a-86f26a76ff61 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:21.615985 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d1bbbaa-b8bd-466a-8b8a-86f26a76ff61 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:21.617948 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d1bbbaa-b8bd-466a-8b8a-86f26a76ff61 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:21.618454 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d1bbbaa-b8bd-466a-8b8a-86f26a76ff61 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:21.642976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-f970f072-17fb-4e6e-b53d-fad627ad5de7 req-0e80fe72-a449-4ad8-9f6a-0df497caaa1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97557fbe-c1f4-464e-93b8-3c71fbc48936", "tag": "0765d95c-b5b8-4eb9-aef1-96129a9a206d"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:21.656182 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f970f072-17fb-4e6e-b53d-fad627ad5de7 req-0e80fe72-a449-4ad8-9f6a-0df497caaa1c service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:21.656936 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f970f072-17fb-4e6e-b53d-fad627ad5de7 req-0e80fe72-a449-4ad8-9f6a-0df497caaa1c service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:21.657533 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f970f072-17fb-4e6e-b53d-fad627ad5de7 req-0e80fe72-a449-4ad8-9f6a-0df497caaa1c service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:21.675114 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-f970f072-17fb-4e6e-b53d-fad627ad5de7 req-0e80fe72-a449-4ad8-9f6a-0df497caaa1c service nova] Creating event network-changed:0765d95c-b5b8-4eb9-aef1-96129a9a206d for instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 on hv-cinder-85743 Sep 23 14:04:21.681267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-f970f072-17fb-4e6e-b53d-fad627ad5de7 req-0e80fe72-a449-4ad8-9f6a-0df497caaa1c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051967 Sep 23 14:04:21.685386 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 123/256] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:04:21.725695 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9d1bbbaa-b8bd-466a-8b8a-86f26a76ff61 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:21.737048 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9d1bbbaa-b8bd-466a-8b8a-86f26a76ff61 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1296 microversion: 2.1 time: 0.139559 Sep 23 14:04:21.737721 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 134/257] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:21 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1296 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:22.211672 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6b8a3cc4-d01f-400f-b45d-d238cf093143 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:22.212778 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6b8a3cc4-d01f-400f-b45d-d238cf093143 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:22.228127 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b8a3cc4-d01f-400f-b45d-d238cf093143 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:22.228687 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b8a3cc4-d01f-400f-b45d-d238cf093143 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:22.229149 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b8a3cc4-d01f-400f-b45d-d238cf093143 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:22.229928 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b8a3cc4-d01f-400f-b45d-d238cf093143 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:22.230664 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b8a3cc4-d01f-400f-b45d-d238cf093143 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:22.231101 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b8a3cc4-d01f-400f-b45d-d238cf093143 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:22.413902 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6b8a3cc4-d01f-400f-b45d-d238cf093143 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:22.422082 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6b8a3cc4-d01f-400f-b45d-d238cf093143 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1366 microversion: 2.1 time: 0.214786 Sep 23 14:04:22.423218 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 124/258] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:22 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:22.500665 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6e891225-f01c-43e0-88a5-ef9ee788ade7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:22.502108 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-6e891225-f01c-43e0-88a5-ef9ee788ade7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:22.508875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6e891225-f01c-43e0-88a5-ef9ee788ade7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:22.509550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6e891225-f01c-43e0-88a5-ef9ee788ade7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:22.509991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6e891225-f01c-43e0-88a5-ef9ee788ade7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:22.510720 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6e891225-f01c-43e0-88a5-ef9ee788ade7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:22.511805 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6e891225-f01c-43e0-88a5-ef9ee788ade7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:22.512247 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6e891225-f01c-43e0-88a5-ef9ee788ade7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:22.722692 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-6e891225-f01c-43e0-88a5-ef9ee788ade7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:22.732150 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-6e891225-f01c-43e0-88a5-ef9ee788ade7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1264 microversion: 2.1 time: 0.237738 Sep 23 14:04:22.732775 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 135/259] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:22 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:22.765834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-96775143-7780-4011-8b48-ec251be2718d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:22.767228 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-96775143-7780-4011-8b48-ec251be2718d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:22.773498 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-96775143-7780-4011-8b48-ec251be2718d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:22.773999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-96775143-7780-4011-8b48-ec251be2718d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:22.774525 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-96775143-7780-4011-8b48-ec251be2718d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:22.775542 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-96775143-7780-4011-8b48-ec251be2718d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:22.776010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-96775143-7780-4011-8b48-ec251be2718d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:22.776641 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-96775143-7780-4011-8b48-ec251be2718d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:22.878562 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-96775143-7780-4011-8b48-ec251be2718d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:22.889226 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-96775143-7780-4011-8b48-ec251be2718d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1314 microversion: 2.1 time: 0.127903 Sep 23 14:04:22.889817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 125/260] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:22 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1314 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:23.450239 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-739ad250-03c0-405d-93a3-8c4b3b5c5592 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:23.457751 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-739ad250-03c0-405d-93a3-8c4b3b5c5592 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:23.469858 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-739ad250-03c0-405d-93a3-8c4b3b5c5592 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:23.470454 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-739ad250-03c0-405d-93a3-8c4b3b5c5592 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:23.470895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-739ad250-03c0-405d-93a3-8c4b3b5c5592 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:23.471604 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-739ad250-03c0-405d-93a3-8c4b3b5c5592 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:23.472061 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-739ad250-03c0-405d-93a3-8c4b3b5c5592 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:23.480187 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-739ad250-03c0-405d-93a3-8c4b3b5c5592 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:23.695636 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-739ad250-03c0-405d-93a3-8c4b3b5c5592 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:23.706006 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-739ad250-03c0-405d-93a3-8c4b3b5c5592 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1366 microversion: 2.1 time: 0.261618 Sep 23 14:04:23.706006 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 136/261] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:23 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:23.756681 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-94f18cb4-c2cc-469d-b9ee-4c0881dfcdde tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:23.757298 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-94f18cb4-c2cc-469d-b9ee-4c0881dfcdde tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:23.763391 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94f18cb4-c2cc-469d-b9ee-4c0881dfcdde tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:23.763887 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94f18cb4-c2cc-469d-b9ee-4c0881dfcdde tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:23.764325 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94f18cb4-c2cc-469d-b9ee-4c0881dfcdde tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:23.765027 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94f18cb4-c2cc-469d-b9ee-4c0881dfcdde tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:23.765487 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94f18cb4-c2cc-469d-b9ee-4c0881dfcdde tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:23.765917 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94f18cb4-c2cc-469d-b9ee-4c0881dfcdde tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:23.920047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1dcbacb2-8d30-4124-906a-f1d9fd232a87 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:23.920657 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1dcbacb2-8d30-4124-906a-f1d9fd232a87 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:23.926952 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1dcbacb2-8d30-4124-906a-f1d9fd232a87 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:23.927453 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1dcbacb2-8d30-4124-906a-f1d9fd232a87 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:23.927897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1dcbacb2-8d30-4124-906a-f1d9fd232a87 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:23.928610 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1dcbacb2-8d30-4124-906a-f1d9fd232a87 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:23.929074 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1dcbacb2-8d30-4124-906a-f1d9fd232a87 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:23.929506 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1dcbacb2-8d30-4124-906a-f1d9fd232a87 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:24.260342 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-94f18cb4-c2cc-469d-b9ee-4c0881dfcdde tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:24.269632 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-94f18cb4-c2cc-469d-b9ee-4c0881dfcdde tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1264 microversion: 2.1 time: 0.516716 Sep 23 14:04:24.270750 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 126/262] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:23 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1264 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:24.301676 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1dcbacb2-8d30-4124-906a-f1d9fd232a87 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:24.310171 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1dcbacb2-8d30-4124-906a-f1d9fd232a87 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1370 microversion: 2.1 time: 0.394939 Sep 23 14:04:24.310850 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 137/263] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:23 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1370 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:24.728554 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-92684b14-d101-41b9-be1d-bdfa0e98113d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:24.729163 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-92684b14-d101-41b9-be1d-bdfa0e98113d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:24.736004 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-92684b14-d101-41b9-be1d-bdfa0e98113d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:24.736433 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-92684b14-d101-41b9-be1d-bdfa0e98113d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:24.736789 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-92684b14-d101-41b9-be1d-bdfa0e98113d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:24.737992 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-92684b14-d101-41b9-be1d-bdfa0e98113d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:24.738520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-92684b14-d101-41b9-be1d-bdfa0e98113d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:24.738950 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-92684b14-d101-41b9-be1d-bdfa0e98113d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:24.778509 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-efabd997-4196-43dc-a6bb-afcb9841e6b7 req-9619f403-e23e-404a-b3f4-f54844081f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6891295c-5fe6-44a7-adf2-f1fb03036261", "tag": "51f6ed4d-0d8a-4bb4-bf7b-e42a43e05409"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:24.788763 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-efabd997-4196-43dc-a6bb-afcb9841e6b7 req-9619f403-e23e-404a-b3f4-f54844081f45 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:24.789242 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-efabd997-4196-43dc-a6bb-afcb9841e6b7 req-9619f403-e23e-404a-b3f4-f54844081f45 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:24.789668 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-efabd997-4196-43dc-a6bb-afcb9841e6b7 req-9619f403-e23e-404a-b3f4-f54844081f45 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:24.801154 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-efabd997-4196-43dc-a6bb-afcb9841e6b7 req-9619f403-e23e-404a-b3f4-f54844081f45 service nova] Creating event network-changed:51f6ed4d-0d8a-4bb4-bf7b-e42a43e05409 for instance 6891295c-5fe6-44a7-adf2-f1fb03036261 on hv-cinder-85743 Sep 23 14:04:24.806108 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-efabd997-4196-43dc-a6bb-afcb9841e6b7 req-9619f403-e23e-404a-b3f4-f54844081f45 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031452 Sep 23 14:04:24.807103 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 138/264] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:04:24.957156 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-92684b14-d101-41b9-be1d-bdfa0e98113d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:24.965005 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-92684b14-d101-41b9-be1d-bdfa0e98113d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1366 microversion: 2.1 time: 0.240327 Sep 23 14:04:24.965608 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 127/265] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:24 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:25.294571 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-359f4d23-9abc-400d-bfe2-eed78534ca33 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:25.295309 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-359f4d23-9abc-400d-bfe2-eed78534ca33 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:25.301578 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-359f4d23-9abc-400d-bfe2-eed78534ca33 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:25.302294 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-359f4d23-9abc-400d-bfe2-eed78534ca33 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:25.302529 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-359f4d23-9abc-400d-bfe2-eed78534ca33 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:25.303229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-359f4d23-9abc-400d-bfe2-eed78534ca33 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:25.303869 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-359f4d23-9abc-400d-bfe2-eed78534ca33 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:25.304305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-359f4d23-9abc-400d-bfe2-eed78534ca33 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:25.336674 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1b5ef3ff-0c35-4f37-8351-e0b441f7bc0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:25.337520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1b5ef3ff-0c35-4f37-8351-e0b441f7bc0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:25.344890 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b5ef3ff-0c35-4f37-8351-e0b441f7bc0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:25.345618 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b5ef3ff-0c35-4f37-8351-e0b441f7bc0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:25.346126 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b5ef3ff-0c35-4f37-8351-e0b441f7bc0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:25.346942 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b5ef3ff-0c35-4f37-8351-e0b441f7bc0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:25.347500 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b5ef3ff-0c35-4f37-8351-e0b441f7bc0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:25.347992 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b5ef3ff-0c35-4f37-8351-e0b441f7bc0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:25.585807 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-359f4d23-9abc-400d-bfe2-eed78534ca33 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:25.593595 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=100 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:25.597622 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-359f4d23-9abc-400d-bfe2-eed78534ca33 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1264 microversion: 2.1 time: 0.307121 Sep 23 14:04:25.599191 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 139/266] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:25 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1264 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:25.619826 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-1b5ef3ff-0c35-4f37-8351-e0b441f7bc0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:25.628447 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1b5ef3ff-0c35-4f37-8351-e0b441f7bc0d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1370 microversion: 2.1 time: 0.296513 Sep 23 14:04:25.629065 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 128/267] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:25 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1370 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:25.660895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-dcf14e48-4e5d-485a-ba00-0293dc5cc885 req-5ed1c5a0-6300-4249-bfe1-07c6b92c12b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760e9fcc-3723-43bd-ab9b-db54f81db1ae", "name": "network-vif-plugged", "status": "completed", "tag": "c01d1346-01d1-4da4-84a3-b81e410d1f69"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:25.671018 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-dcf14e48-4e5d-485a-ba00-0293dc5cc885 req-5ed1c5a0-6300-4249-bfe1-07c6b92c12b5 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:25.671503 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-dcf14e48-4e5d-485a-ba00-0293dc5cc885 req-5ed1c5a0-6300-4249-bfe1-07c6b92c12b5 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:25.671941 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-dcf14e48-4e5d-485a-ba00-0293dc5cc885 req-5ed1c5a0-6300-4249-bfe1-07c6b92c12b5 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:25.683467 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-dcf14e48-4e5d-485a-ba00-0293dc5cc885 req-5ed1c5a0-6300-4249-bfe1-07c6b92c12b5 service nova] Creating event network-vif-plugged:c01d1346-01d1-4da4-84a3-b81e410d1f69 for instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae on hv-cinder-85743 Sep 23 14:04:25.688480 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-dcf14e48-4e5d-485a-ba00-0293dc5cc885 req-5ed1c5a0-6300-4249-bfe1-07c6b92c12b5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031688 Sep 23 14:04:25.689073 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 140/268] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:04:25.988222 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fccb8490-cadb-47dd-b5aa-62dc6b3b7aeb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:25.988828 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-fccb8490-cadb-47dd-b5aa-62dc6b3b7aeb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:25.994887 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fccb8490-cadb-47dd-b5aa-62dc6b3b7aeb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:25.995953 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fccb8490-cadb-47dd-b5aa-62dc6b3b7aeb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:25.996487 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fccb8490-cadb-47dd-b5aa-62dc6b3b7aeb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:25.997188 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fccb8490-cadb-47dd-b5aa-62dc6b3b7aeb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:25.997645 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fccb8490-cadb-47dd-b5aa-62dc6b3b7aeb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:25.998073 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fccb8490-cadb-47dd-b5aa-62dc6b3b7aeb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:26.138099 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fccb8490-cadb-47dd-b5aa-62dc6b3b7aeb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:26.146090 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fccb8490-cadb-47dd-b5aa-62dc6b3b7aeb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1366 microversion: 2.1 time: 0.161761 Sep 23 14:04:26.146975 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 129/269] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:25 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:26.622808 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-28c8f904-44b0-49ab-a664-cd508153abf8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:26.623801 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-28c8f904-44b0-49ab-a664-cd508153abf8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:26.631522 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28c8f904-44b0-49ab-a664-cd508153abf8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:26.632147 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28c8f904-44b0-49ab-a664-cd508153abf8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:26.632679 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28c8f904-44b0-49ab-a664-cd508153abf8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:26.633580 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28c8f904-44b0-49ab-a664-cd508153abf8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:26.634210 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28c8f904-44b0-49ab-a664-cd508153abf8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:26.634839 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28c8f904-44b0-49ab-a664-cd508153abf8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:26.651822 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-2cf3a1f9-350a-448a-979c-55592e80e0bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:26.653004 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-2cf3a1f9-350a-448a-979c-55592e80e0bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:26.659783 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2cf3a1f9-350a-448a-979c-55592e80e0bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:26.660276 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2cf3a1f9-350a-448a-979c-55592e80e0bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:26.660712 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2cf3a1f9-350a-448a-979c-55592e80e0bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:26.661409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2cf3a1f9-350a-448a-979c-55592e80e0bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:26.661864 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2cf3a1f9-350a-448a-979c-55592e80e0bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:26.662291 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2cf3a1f9-350a-448a-979c-55592e80e0bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:26.853254 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-28c8f904-44b0-49ab-a664-cd508153abf8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:26.858285 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-2cf3a1f9-350a-448a-979c-55592e80e0bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:26.862309 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-28c8f904-44b0-49ab-a664-cd508153abf8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1264 microversion: 2.1 time: 0.244885 Sep 23 14:04:26.862903 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 141/270] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:26 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1264 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:26.870470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-2cf3a1f9-350a-448a-979c-55592e80e0bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1370 microversion: 2.1 time: 0.221666 Sep 23 14:04:26.874844 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 130/271] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:26 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:27.170729 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9cb0cfcf-4788-40e5-867d-55d81115674c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:27.171291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9cb0cfcf-4788-40e5-867d-55d81115674c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:27.177179 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9cb0cfcf-4788-40e5-867d-55d81115674c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:27.177663 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9cb0cfcf-4788-40e5-867d-55d81115674c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:27.178093 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9cb0cfcf-4788-40e5-867d-55d81115674c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:27.178850 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9cb0cfcf-4788-40e5-867d-55d81115674c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:27.179305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9cb0cfcf-4788-40e5-867d-55d81115674c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:27.179728 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9cb0cfcf-4788-40e5-867d-55d81115674c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:27.313477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9cb0cfcf-4788-40e5-867d-55d81115674c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:27.321160 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9cb0cfcf-4788-40e5-867d-55d81115674c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1366 microversion: 2.1 time: 0.154874 Sep 23 14:04:27.321724 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 142/272] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:27 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:27.890393 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f94f2255-bef3-4a91-977e-d420394b9d64 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:27.891038 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f94f2255-bef3-4a91-977e-d420394b9d64 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:27.893283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-39db3687-325e-46a0-82e7-9e68579517dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:27.893904 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-39db3687-325e-46a0-82e7-9e68579517dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:27.897046 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f94f2255-bef3-4a91-977e-d420394b9d64 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:27.897540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f94f2255-bef3-4a91-977e-d420394b9d64 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:27.897987 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f94f2255-bef3-4a91-977e-d420394b9d64 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:27.898713 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f94f2255-bef3-4a91-977e-d420394b9d64 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:27.899271 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f94f2255-bef3-4a91-977e-d420394b9d64 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:27.899660 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f94f2255-bef3-4a91-977e-d420394b9d64 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:27.902233 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39db3687-325e-46a0-82e7-9e68579517dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:27.902758 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39db3687-325e-46a0-82e7-9e68579517dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:27.903307 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39db3687-325e-46a0-82e7-9e68579517dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:27.904007 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39db3687-325e-46a0-82e7-9e68579517dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:27.904465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39db3687-325e-46a0-82e7-9e68579517dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:27.904893 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39db3687-325e-46a0-82e7-9e68579517dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:28.049837 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:28.145839 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-39db3687-325e-46a0-82e7-9e68579517dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:28.154430 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-39db3687-325e-46a0-82e7-9e68579517dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1370 microversion: 2.1 time: 0.264887 Sep 23 14:04:28.155295 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 143/273] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:27 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:28.160877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f94f2255-bef3-4a91-977e-d420394b9d64 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:28.169697 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f94f2255-bef3-4a91-977e-d420394b9d64 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1264 microversion: 2.1 time: 0.283442 Sep 23 14:04:28.170388 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 131/274] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:27 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1264 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:28.344829 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-89c1ce98-40ff-4369-9cc2-6bc6fe329c21 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:28.345362 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-89c1ce98-40ff-4369-9cc2-6bc6fe329c21 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:28.351499 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-89c1ce98-40ff-4369-9cc2-6bc6fe329c21 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:28.352067 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-89c1ce98-40ff-4369-9cc2-6bc6fe329c21 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:28.352572 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-89c1ce98-40ff-4369-9cc2-6bc6fe329c21 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:28.353329 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-89c1ce98-40ff-4369-9cc2-6bc6fe329c21 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:28.353854 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-89c1ce98-40ff-4369-9cc2-6bc6fe329c21 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:28.354431 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-89c1ce98-40ff-4369-9cc2-6bc6fe329c21 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:28.483512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-89c1ce98-40ff-4369-9cc2-6bc6fe329c21 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:28.491031 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-89c1ce98-40ff-4369-9cc2-6bc6fe329c21 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1366 microversion: 2.1 time: 0.150210 Sep 23 14:04:28.491593 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 144/275] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:28 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:28.713384 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-243466072", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452"}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:28.764924 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.network.neutron [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] validate_networks() for None {{(pid=121074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:04:29.029621 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Flavor limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:04:29.030193 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Image limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:04:29.030551 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Flavor pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:04:29.030964 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Image pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:04:29.031380 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:04:29.039976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:29.040460 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:29.040894 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:29.042132 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:29.042614 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:29.043052 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:29.060041 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Getting quotas for project 8f795f5f1a0541e28e28c4fc48877888. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:04:29.064046 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Getting quotas for user e4de1df05f09452fa54a560f1934b62d and project 8f795f5f1a0541e28e28c4fc48877888. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:04:29.074784 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Going to run 1 instances... {{(pid=121074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:04:29.077017 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:04:29.181206 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c479b033-110b-473f-a115-b401f9fa21ea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:29.181912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c479b033-110b-473f-a115-b401f9fa21ea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:29.184041 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:29.196297 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c479b033-110b-473f-a115-b401f9fa21ea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:29.196297 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c479b033-110b-473f-a115-b401f9fa21ea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:29.196297 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c479b033-110b-473f-a115-b401f9fa21ea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:29.196297 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c479b033-110b-473f-a115-b401f9fa21ea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:29.196690 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c479b033-110b-473f-a115-b401f9fa21ea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:29.196690 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c479b033-110b-473f-a115-b401f9fa21ea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:29.201576 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-dde6d1fd-9843-4759-92c2-9626243fe411 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491879 Sep 23 14:04:29.208766 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 132/276] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:04:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 14:04:29.208766 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8deea677-adcb-4034-98ce-6e08984805ba tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:29.208766 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8deea677-adcb-4034-98ce-6e08984805ba tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:29.214957 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8deea677-adcb-4034-98ce-6e08984805ba tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:29.219424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8deea677-adcb-4034-98ce-6e08984805ba tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:29.219424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8deea677-adcb-4034-98ce-6e08984805ba tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:29.219424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8deea677-adcb-4034-98ce-6e08984805ba tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:29.219424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8deea677-adcb-4034-98ce-6e08984805ba tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:29.220297 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8deea677-adcb-4034-98ce-6e08984805ba tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:29.403051 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c479b033-110b-473f-a115-b401f9fa21ea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:29.410850 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c479b033-110b-473f-a115-b401f9fa21ea tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1370 microversion: 2.1 time: 0.233473 Sep 23 14:04:29.411612 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 145/277] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:29 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:29.414462 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8deea677-adcb-4034-98ce-6e08984805ba tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:29.416295 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d055947d-523d-4f2c-bb4c-6dd4a1a5ea9f tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:29.418474 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d055947d-523d-4f2c-bb4c-6dd4a1a5ea9f tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:29.429351 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8deea677-adcb-4034-98ce-6e08984805ba tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1264 microversion: 2.1 time: 0.226021 Sep 23 14:04:29.430227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 133/278] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:29 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1264 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:29.475537 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d055947d-523d-4f2c-bb4c-6dd4a1a5ea9f tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:29.483514 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d055947d-523d-4f2c-bb4c-6dd4a1a5ea9f tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1214 microversion: 2.1 time: 0.070720 Sep 23 14:04:29.484095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 146/279] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:29 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:29.515011 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e10e7832-60d0-453e-8e6a-da57a50f671e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:29.515699 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e10e7832-60d0-453e-8e6a-da57a50f671e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:29.521606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e10e7832-60d0-453e-8e6a-da57a50f671e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:29.522091 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e10e7832-60d0-453e-8e6a-da57a50f671e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:29.522600 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e10e7832-60d0-453e-8e6a-da57a50f671e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:29.523292 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e10e7832-60d0-453e-8e6a-da57a50f671e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:29.523778 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e10e7832-60d0-453e-8e6a-da57a50f671e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:29.524205 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e10e7832-60d0-453e-8e6a-da57a50f671e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:29.660740 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e10e7832-60d0-453e-8e6a-da57a50f671e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:29.670360 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e10e7832-60d0-453e-8e6a-da57a50f671e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1366 microversion: 2.1 time: 0.159877 Sep 23 14:04:29.670969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 134/280] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:29 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:29.776895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-8fd22d51-bab1-44ad-9cf1-a3e0bc9da571 req-cd47ea8a-c53b-4997-94f9-099ea2074eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a131c7-2478-421b-86df-633cca15c7b7", "name": "network-vif-plugged", "status": "completed", "tag": "894a169a-68e6-48c8-88fa-1d068254a466"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:29.787114 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-8fd22d51-bab1-44ad-9cf1-a3e0bc9da571 req-cd47ea8a-c53b-4997-94f9-099ea2074eeb service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:29.787595 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-8fd22d51-bab1-44ad-9cf1-a3e0bc9da571 req-cd47ea8a-c53b-4997-94f9-099ea2074eeb service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:29.788123 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-8fd22d51-bab1-44ad-9cf1-a3e0bc9da571 req-cd47ea8a-c53b-4997-94f9-099ea2074eeb service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:29.800052 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-8fd22d51-bab1-44ad-9cf1-a3e0bc9da571 req-cd47ea8a-c53b-4997-94f9-099ea2074eeb service nova] Creating event network-vif-plugged:894a169a-68e6-48c8-88fa-1d068254a466 for instance 51a131c7-2478-421b-86df-633cca15c7b7 on hv-cinder-85743 Sep 23 14:04:29.805139 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-8fd22d51-bab1-44ad-9cf1-a3e0bc9da571 req-cd47ea8a-c53b-4997-94f9-099ea2074eeb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032698 Sep 23 14:04:29.805747 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 147/281] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:04:30.436410 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-3f7587fb-ae0e-4993-a600-57725177d273 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:30.437019 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-3f7587fb-ae0e-4993-a600-57725177d273 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:30.444078 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f7587fb-ae0e-4993-a600-57725177d273 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:30.444570 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f7587fb-ae0e-4993-a600-57725177d273 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:30.445197 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f7587fb-ae0e-4993-a600-57725177d273 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:30.445906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f7587fb-ae0e-4993-a600-57725177d273 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:30.446389 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f7587fb-ae0e-4993-a600-57725177d273 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:30.446835 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f7587fb-ae0e-4993-a600-57725177d273 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:30.454884 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b629769e-6052-4911-a9c6-fff93c6fcd0e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:30.455768 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b629769e-6052-4911-a9c6-fff93c6fcd0e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:30.462653 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b629769e-6052-4911-a9c6-fff93c6fcd0e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:30.462653 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b629769e-6052-4911-a9c6-fff93c6fcd0e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:30.463108 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b629769e-6052-4911-a9c6-fff93c6fcd0e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:30.464012 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b629769e-6052-4911-a9c6-fff93c6fcd0e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:30.464622 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b629769e-6052-4911-a9c6-fff93c6fcd0e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:30.465054 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b629769e-6052-4911-a9c6-fff93c6fcd0e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:30.641413 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-3f7587fb-ae0e-4993-a600-57725177d273 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:30.649234 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-3f7587fb-ae0e-4993-a600-57725177d273 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1370 microversion: 2.1 time: 0.217782 Sep 23 14:04:30.649828 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 135/282] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:30 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:30.654763 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b629769e-6052-4911-a9c6-fff93c6fcd0e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:30.654960 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-47e99f90-e7e7-4c3f-84f0-f055f54a16ad tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:30.655578 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-47e99f90-e7e7-4c3f-84f0-f055f54a16ad tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:30.661732 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-47e99f90-e7e7-4c3f-84f0-f055f54a16ad tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:30.662419 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-47e99f90-e7e7-4c3f-84f0-f055f54a16ad tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:30.662809 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b629769e-6052-4911-a9c6-fff93c6fcd0e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1264 microversion: 2.1 time: 0.213483 Sep 23 14:04:30.663013 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-47e99f90-e7e7-4c3f-84f0-f055f54a16ad tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:30.665598 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 148/283] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:30 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1264 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:30.665748 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-47e99f90-e7e7-4c3f-84f0-f055f54a16ad tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:30.665748 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-47e99f90-e7e7-4c3f-84f0-f055f54a16ad tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:30.665748 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-47e99f90-e7e7-4c3f-84f0-f055f54a16ad tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:30.692949 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-34c5b86a-c8ab-45c8-b836-3b1e66dbf321 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:30.693560 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-34c5b86a-c8ab-45c8-b836-3b1e66dbf321 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:30.699522 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-34c5b86a-c8ab-45c8-b836-3b1e66dbf321 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:30.700015 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-34c5b86a-c8ab-45c8-b836-3b1e66dbf321 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:30.700456 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-34c5b86a-c8ab-45c8-b836-3b1e66dbf321 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:30.701180 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-34c5b86a-c8ab-45c8-b836-3b1e66dbf321 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:30.701642 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-34c5b86a-c8ab-45c8-b836-3b1e66dbf321 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:30.702069 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-34c5b86a-c8ab-45c8-b836-3b1e66dbf321 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:30.724756 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-47e99f90-e7e7-4c3f-84f0-f055f54a16ad tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:30.732598 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-47e99f90-e7e7-4c3f-84f0-f055f54a16ad tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1218 microversion: 2.1 time: 0.081811 Sep 23 14:04:30.733171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 136/284] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:30 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:30.832066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-34c5b86a-c8ab-45c8-b836-3b1e66dbf321 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:30.840075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-34c5b86a-c8ab-45c8-b836-3b1e66dbf321 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1556 microversion: 2.1 time: 0.150865 Sep 23 14:04:30.840642 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 149/285] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:30 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:30.862528 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-837e0494-a498-4399-8430-9bd518870678 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:30.863016 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-837e0494-a498-4399-8430-9bd518870678 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:30.865024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:30.870151 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-837e0494-a498-4399-8430-9bd518870678 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:30.870775 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-837e0494-a498-4399-8430-9bd518870678 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:30.871179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-837e0494-a498-4399-8430-9bd518870678 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:30.871865 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-837e0494-a498-4399-8430-9bd518870678 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:30.872318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-837e0494-a498-4399-8430-9bd518870678 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:30.872741 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-837e0494-a498-4399-8430-9bd518870678 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:30.950756 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-837e0494-a498-4399-8430-9bd518870678 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091778 Sep 23 14:04:30.951491 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 137/286] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 23 14:04:30 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:04:31.673960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a0075628-103a-442d-8374-9777b332ca53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:31.674847 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a0075628-103a-442d-8374-9777b332ca53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:31.683366 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0075628-103a-442d-8374-9777b332ca53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:31.684130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0075628-103a-442d-8374-9777b332ca53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:31.684562 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0075628-103a-442d-8374-9777b332ca53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:31.685673 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0075628-103a-442d-8374-9777b332ca53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:31.686292 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0075628-103a-442d-8374-9777b332ca53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:31.686739 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0075628-103a-442d-8374-9777b332ca53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:31.688578 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1bddb814-fa22-409a-addb-6a93c452b980 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:31.689205 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1bddb814-fa22-409a-addb-6a93c452b980 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:31.700327 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1bddb814-fa22-409a-addb-6a93c452b980 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:31.700899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1bddb814-fa22-409a-addb-6a93c452b980 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:31.701338 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1bddb814-fa22-409a-addb-6a93c452b980 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:31.702047 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1bddb814-fa22-409a-addb-6a93c452b980 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:31.702539 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1bddb814-fa22-409a-addb-6a93c452b980 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:31.703029 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1bddb814-fa22-409a-addb-6a93c452b980 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:31.896613 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a0075628-103a-442d-8374-9777b332ca53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:31.900103 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-1bddb814-fa22-409a-addb-6a93c452b980 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:31.905316 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a0075628-103a-442d-8374-9777b332ca53 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1370 microversion: 2.1 time: 0.235154 Sep 23 14:04:31.909860 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1bddb814-fa22-409a-addb-6a93c452b980 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1264 microversion: 2.1 time: 0.228024 Sep 23 14:04:31.910671 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 138/287] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:31 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:31.915566 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-069e4446-4b5e-4641-871d-902ac795eba6 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:31.916261 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-069e4446-4b5e-4641-871d-902ac795eba6 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:31.918961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 150/288] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:31 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:31.923429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-069e4446-4b5e-4641-871d-902ac795eba6 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:31.923993 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-069e4446-4b5e-4641-871d-902ac795eba6 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:31.924521 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-069e4446-4b5e-4641-871d-902ac795eba6 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:31.925285 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-069e4446-4b5e-4641-871d-902ac795eba6 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:31.925810 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-069e4446-4b5e-4641-871d-902ac795eba6 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:31.926305 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-069e4446-4b5e-4641-871d-902ac795eba6 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:31.938595 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-2926791f-9b1c-4526-bde1-3c0be59424a1 req-f1e9e039-0658-46db-b316-431264edfd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6891295c-5fe6-44a7-adf2-f1fb03036261", "name": "network-vif-plugged", "status": "completed", "tag": "51f6ed4d-0d8a-4bb4-bf7b-e42a43e05409"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:31.950221 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2926791f-9b1c-4526-bde1-3c0be59424a1 req-f1e9e039-0658-46db-b316-431264edfd56 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:31.951027 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2926791f-9b1c-4526-bde1-3c0be59424a1 req-f1e9e039-0658-46db-b316-431264edfd56 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:31.951893 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2926791f-9b1c-4526-bde1-3c0be59424a1 req-f1e9e039-0658-46db-b316-431264edfd56 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:31.966382 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-2926791f-9b1c-4526-bde1-3c0be59424a1 req-f1e9e039-0658-46db-b316-431264edfd56 service nova] Creating event network-vif-plugged:51f6ed4d-0d8a-4bb4-bf7b-e42a43e05409 for instance 6891295c-5fe6-44a7-adf2-f1fb03036261 on hv-cinder-85743 Sep 23 14:04:31.971307 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-2926791f-9b1c-4526-bde1-3c0be59424a1 req-f1e9e039-0658-46db-b316-431264edfd56 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050872 Sep 23 14:04:31.973641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 151/289] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:04:31.996525 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-069e4446-4b5e-4641-871d-902ac795eba6 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:32.007381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-069e4446-4b5e-4641-871d-902ac795eba6 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1266 microversion: 2.1 time: 0.095438 Sep 23 14:04:32.019509 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 139/290] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:31 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:32.029645 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-8c341491-0155-40c7-883e-365bf76aadd0 req-c07d3328-3924-4d55-b2cc-6ff7fbddb90e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760e9fcc-3723-43bd-ab9b-db54f81db1ae", "tag": "c01d1346-01d1-4da4-84a3-b81e410d1f69"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:32.039410 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-8c341491-0155-40c7-883e-365bf76aadd0 req-c07d3328-3924-4d55-b2cc-6ff7fbddb90e service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:32.039898 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-8c341491-0155-40c7-883e-365bf76aadd0 req-c07d3328-3924-4d55-b2cc-6ff7fbddb90e service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:32.040335 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-8c341491-0155-40c7-883e-365bf76aadd0 req-c07d3328-3924-4d55-b2cc-6ff7fbddb90e service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:32.051557 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-8c341491-0155-40c7-883e-365bf76aadd0 req-c07d3328-3924-4d55-b2cc-6ff7fbddb90e service nova] Creating event network-changed:c01d1346-01d1-4da4-84a3-b81e410d1f69 for instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae on hv-cinder-85743 Sep 23 14:04:32.056467 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-8c341491-0155-40c7-883e-365bf76aadd0 req-c07d3328-3924-4d55-b2cc-6ff7fbddb90e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031374 Sep 23 14:04:32.059606 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 152/291] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:04:32.936474 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6cb47ae5-7d9a-44cb-98c8-7a985bcfadac tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:32.937097 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6cb47ae5-7d9a-44cb-98c8-7a985bcfadac tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:32.943909 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6cb47ae5-7d9a-44cb-98c8-7a985bcfadac tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:32.944419 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6cb47ae5-7d9a-44cb-98c8-7a985bcfadac tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:32.944860 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6cb47ae5-7d9a-44cb-98c8-7a985bcfadac tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:32.945569 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6cb47ae5-7d9a-44cb-98c8-7a985bcfadac tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:32.946033 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6cb47ae5-7d9a-44cb-98c8-7a985bcfadac tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:32.946495 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6cb47ae5-7d9a-44cb-98c8-7a985bcfadac tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:32.946594 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f5739bac-1ee3-4ecf-97ab-82addac5c8e7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:32.947274 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f5739bac-1ee3-4ecf-97ab-82addac5c8e7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:32.954425 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f5739bac-1ee3-4ecf-97ab-82addac5c8e7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:32.954917 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f5739bac-1ee3-4ecf-97ab-82addac5c8e7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:32.955338 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f5739bac-1ee3-4ecf-97ab-82addac5c8e7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:32.956054 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f5739bac-1ee3-4ecf-97ab-82addac5c8e7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:32.956513 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f5739bac-1ee3-4ecf-97ab-82addac5c8e7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:32.956936 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f5739bac-1ee3-4ecf-97ab-82addac5c8e7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:33.159748 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6cb47ae5-7d9a-44cb-98c8-7a985bcfadac tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:33.163153 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=100 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:33.172147 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6cb47ae5-7d9a-44cb-98c8-7a985bcfadac tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1451 microversion: 2.1 time: 0.240018 Sep 23 14:04:33.173550 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 140/292] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:32 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1451 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:33.179509 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6fdb8ba9-dba4-4d35-82b1-2462389bde1b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:33.180563 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6fdb8ba9-dba4-4d35-82b1-2462389bde1b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:33.188699 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fdb8ba9-dba4-4d35-82b1-2462389bde1b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:33.189444 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fdb8ba9-dba4-4d35-82b1-2462389bde1b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:33.190069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fdb8ba9-dba4-4d35-82b1-2462389bde1b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:33.191449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fdb8ba9-dba4-4d35-82b1-2462389bde1b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:33.191915 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fdb8ba9-dba4-4d35-82b1-2462389bde1b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:33.192371 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fdb8ba9-dba4-4d35-82b1-2462389bde1b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:33.211276 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f5739bac-1ee3-4ecf-97ab-82addac5c8e7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:33.223239 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f5739bac-1ee3-4ecf-97ab-82addac5c8e7 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1370 microversion: 2.1 time: 0.281545 Sep 23 14:04:33.240174 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 153/293] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:32 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1370 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:33.250657 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-0ac5a18e-89aa-4b88-9fab-4ec57291e271 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:33.250657 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-0ac5a18e-89aa-4b88-9fab-4ec57291e271 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:33.255411 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0ac5a18e-89aa-4b88-9fab-4ec57291e271 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:33.256163 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0ac5a18e-89aa-4b88-9fab-4ec57291e271 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:33.256811 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0ac5a18e-89aa-4b88-9fab-4ec57291e271 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:33.257573 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0ac5a18e-89aa-4b88-9fab-4ec57291e271 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:33.258096 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0ac5a18e-89aa-4b88-9fab-4ec57291e271 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:33.258622 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0ac5a18e-89aa-4b88-9fab-4ec57291e271 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:33.289200 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6fdb8ba9-dba4-4d35-82b1-2462389bde1b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:33.297435 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6fdb8ba9-dba4-4d35-82b1-2462389bde1b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1266 microversion: 2.1 time: 0.122270 Sep 23 14:04:33.298035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 141/294] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:33 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:33.397184 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-0ac5a18e-89aa-4b88-9fab-4ec57291e271 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:33.405470 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-0ac5a18e-89aa-4b88-9fab-4ec57291e271 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1451 microversion: 2.1 time: 0.163762 Sep 23 14:04:33.406038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 154/295] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:33 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:34.256714 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f456eeb2-4ceb-4353-ac26-1803f71c8872 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:34.260702 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f456eeb2-4ceb-4353-ac26-1803f71c8872 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:34.272204 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f456eeb2-4ceb-4353-ac26-1803f71c8872 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:34.276965 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f456eeb2-4ceb-4353-ac26-1803f71c8872 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:34.283801 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f456eeb2-4ceb-4353-ac26-1803f71c8872 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:34.283801 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f456eeb2-4ceb-4353-ac26-1803f71c8872 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:34.283801 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f456eeb2-4ceb-4353-ac26-1803f71c8872 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:34.283801 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f456eeb2-4ceb-4353-ac26-1803f71c8872 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:34.320360 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-400e6dd5-b3da-4d78-9bba-4dd46b76ca88 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:34.321114 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-400e6dd5-b3da-4d78-9bba-4dd46b76ca88 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:34.327720 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-400e6dd5-b3da-4d78-9bba-4dd46b76ca88 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:34.328202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-400e6dd5-b3da-4d78-9bba-4dd46b76ca88 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:34.328649 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-400e6dd5-b3da-4d78-9bba-4dd46b76ca88 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:34.329320 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-400e6dd5-b3da-4d78-9bba-4dd46b76ca88 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:34.329773 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-400e6dd5-b3da-4d78-9bba-4dd46b76ca88 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:34.330195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-400e6dd5-b3da-4d78-9bba-4dd46b76ca88 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:34.468018 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-400e6dd5-b3da-4d78-9bba-4dd46b76ca88 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:34.477034 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-400e6dd5-b3da-4d78-9bba-4dd46b76ca88 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1274 microversion: 2.1 time: 0.160541 Sep 23 14:04:34.477736 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 155/296] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:34 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:34.646932 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f456eeb2-4ceb-4353-ac26-1803f71c8872 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:34.657031 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f456eeb2-4ceb-4353-ac26-1803f71c8872 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1370 microversion: 2.1 time: 0.408471 Sep 23 14:04:34.673105 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 142/297] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:34 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1370 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:35.500709 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5e49ffaf-80ef-4df3-8e2c-a2fe7d4b9011 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:35.501251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5e49ffaf-80ef-4df3-8e2c-a2fe7d4b9011 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:35.507778 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e49ffaf-80ef-4df3-8e2c-a2fe7d4b9011 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:35.508274 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e49ffaf-80ef-4df3-8e2c-a2fe7d4b9011 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:35.508723 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e49ffaf-80ef-4df3-8e2c-a2fe7d4b9011 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:35.509420 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e49ffaf-80ef-4df3-8e2c-a2fe7d4b9011 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:35.509915 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e49ffaf-80ef-4df3-8e2c-a2fe7d4b9011 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:35.510396 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e49ffaf-80ef-4df3-8e2c-a2fe7d4b9011 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:35.682785 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1517ae13-9e10-4a63-85a8-7847466817b3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:35.684518 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1517ae13-9e10-4a63-85a8-7847466817b3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:35.695720 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1517ae13-9e10-4a63-85a8-7847466817b3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:35.701077 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1517ae13-9e10-4a63-85a8-7847466817b3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:35.701077 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1517ae13-9e10-4a63-85a8-7847466817b3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:35.701077 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1517ae13-9e10-4a63-85a8-7847466817b3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:35.701077 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1517ae13-9e10-4a63-85a8-7847466817b3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:35.703286 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1517ae13-9e10-4a63-85a8-7847466817b3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:35.723022 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5e49ffaf-80ef-4df3-8e2c-a2fe7d4b9011 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:35.733518 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5e49ffaf-80ef-4df3-8e2c-a2fe7d4b9011 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1314 microversion: 2.1 time: 0.236637 Sep 23 14:04:35.735867 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 156/298] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:35 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:35.919572 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-1517ae13-9e10-4a63-85a8-7847466817b3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:35.930942 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1517ae13-9e10-4a63-85a8-7847466817b3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1565 microversion: 2.1 time: 0.252772 Sep 23 14:04:35.932105 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 143/299] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:35 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1565 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:35.956314 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-fcfc95a0-2891-40cb-a9d1-9b0885a2e021 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:35.957092 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-fcfc95a0-2891-40cb-a9d1-9b0885a2e021 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:35.966095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fcfc95a0-2891-40cb-a9d1-9b0885a2e021 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:35.966095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fcfc95a0-2891-40cb-a9d1-9b0885a2e021 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:35.966095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fcfc95a0-2891-40cb-a9d1-9b0885a2e021 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:35.966678 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fcfc95a0-2891-40cb-a9d1-9b0885a2e021 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:35.967342 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fcfc95a0-2891-40cb-a9d1-9b0885a2e021 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:35.967842 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fcfc95a0-2891-40cb-a9d1-9b0885a2e021 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:36.051267 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-fcfc95a0-2891-40cb-a9d1-9b0885a2e021 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099016 Sep 23 14:04:36.051890 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 157/300] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 23 14:04:35 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:04:36.220252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-2bbef0e8-b0e6-48c5-a0fa-93b6b4c25319 req-966d6644-5143-40dd-98df-7e2108781222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f494b01-791a-4c3d-af21-0acceb3aedec", "tag": "3dccf39d-2e29-4cc0-a163-7c174916734c"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:36.242930 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-2bbef0e8-b0e6-48c5-a0fa-93b6b4c25319 req-966d6644-5143-40dd-98df-7e2108781222 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:36.243414 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-2bbef0e8-b0e6-48c5-a0fa-93b6b4c25319 req-966d6644-5143-40dd-98df-7e2108781222 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:36.245158 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-2bbef0e8-b0e6-48c5-a0fa-93b6b4c25319 req-966d6644-5143-40dd-98df-7e2108781222 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:36.263487 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-2bbef0e8-b0e6-48c5-a0fa-93b6b4c25319 req-966d6644-5143-40dd-98df-7e2108781222 service nova] Creating event network-changed:3dccf39d-2e29-4cc0-a163-7c174916734c for instance 2f494b01-791a-4c3d-af21-0acceb3aedec on hv-cinder-85743 Sep 23 14:04:36.268663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-2bbef0e8-b0e6-48c5-a0fa-93b6b4c25319 req-966d6644-5143-40dd-98df-7e2108781222 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060293 Sep 23 14:04:36.269850 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 144/301] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:04:36.419039 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-3442e270-4b31-458a-be44-c79ebafbf4cc req-65dd7896-d118-4904-8ec5-00df72588ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a131c7-2478-421b-86df-633cca15c7b7", "tag": "894a169a-68e6-48c8-88fa-1d068254a466"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:36.435548 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-3442e270-4b31-458a-be44-c79ebafbf4cc req-65dd7896-d118-4904-8ec5-00df72588ece service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:36.436405 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-3442e270-4b31-458a-be44-c79ebafbf4cc req-65dd7896-d118-4904-8ec5-00df72588ece service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:36.437551 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-3442e270-4b31-458a-be44-c79ebafbf4cc req-65dd7896-d118-4904-8ec5-00df72588ece service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:36.457377 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-3442e270-4b31-458a-be44-c79ebafbf4cc req-65dd7896-d118-4904-8ec5-00df72588ece service nova] Creating event network-changed:894a169a-68e6-48c8-88fa-1d068254a466 for instance 51a131c7-2478-421b-86df-633cca15c7b7 on hv-cinder-85743 Sep 23 14:04:36.465206 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-3442e270-4b31-458a-be44-c79ebafbf4cc req-65dd7896-d118-4904-8ec5-00df72588ece service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049925 Sep 23 14:04:36.466377 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 158/302] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:04:36.759655 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-63621796-1120-4da9-b723-4519f9677468 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:36.760489 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-63621796-1120-4da9-b723-4519f9677468 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:36.768519 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63621796-1120-4da9-b723-4519f9677468 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:36.769340 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63621796-1120-4da9-b723-4519f9677468 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:36.769983 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63621796-1120-4da9-b723-4519f9677468 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:36.771545 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63621796-1120-4da9-b723-4519f9677468 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:36.773585 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63621796-1120-4da9-b723-4519f9677468 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:36.774160 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63621796-1120-4da9-b723-4519f9677468 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:37.120939 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-63621796-1120-4da9-b723-4519f9677468 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:37.130796 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-63621796-1120-4da9-b723-4519f9677468 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1314 microversion: 2.1 time: 0.375895 Sep 23 14:04:37.131469 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 145/303] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:36 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:38.154022 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-23b5f53e-1d00-404c-8d15-ffadf9a87aca tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:38.154747 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-23b5f53e-1d00-404c-8d15-ffadf9a87aca tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:38.161608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-23b5f53e-1d00-404c-8d15-ffadf9a87aca tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:38.162256 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-23b5f53e-1d00-404c-8d15-ffadf9a87aca tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:38.162576 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-23b5f53e-1d00-404c-8d15-ffadf9a87aca tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:38.163278 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-23b5f53e-1d00-404c-8d15-ffadf9a87aca tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:38.163731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-23b5f53e-1d00-404c-8d15-ffadf9a87aca tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:38.164150 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-23b5f53e-1d00-404c-8d15-ffadf9a87aca tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:38.304138 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-23b5f53e-1d00-404c-8d15-ffadf9a87aca tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:38.312433 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-23b5f53e-1d00-404c-8d15-ffadf9a87aca tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1314 microversion: 2.1 time: 0.162817 Sep 23 14:04:38.313001 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 159/304] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:38 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:38.495683 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-0b4e24d5-87d0-420a-a2bd-f54896959839 req-a25acfd7-cdef-44de-89de-f2623d2d69ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6891295c-5fe6-44a7-adf2-f1fb03036261", "tag": "51f6ed4d-0d8a-4bb4-bf7b-e42a43e05409"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:38.505448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-0b4e24d5-87d0-420a-a2bd-f54896959839 req-a25acfd7-cdef-44de-89de-f2623d2d69ca service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:38.505933 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-0b4e24d5-87d0-420a-a2bd-f54896959839 req-a25acfd7-cdef-44de-89de-f2623d2d69ca service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:38.506389 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-0b4e24d5-87d0-420a-a2bd-f54896959839 req-a25acfd7-cdef-44de-89de-f2623d2d69ca service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:38.518316 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-0b4e24d5-87d0-420a-a2bd-f54896959839 req-a25acfd7-cdef-44de-89de-f2623d2d69ca service nova] Creating event network-changed:51f6ed4d-0d8a-4bb4-bf7b-e42a43e05409 for instance 6891295c-5fe6-44a7-adf2-f1fb03036261 on hv-cinder-85743 Sep 23 14:04:38.523473 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-0b4e24d5-87d0-420a-a2bd-f54896959839 req-a25acfd7-cdef-44de-89de-f2623d2d69ca service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031533 Sep 23 14:04:38.524073 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 146/305] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:04:39.335596 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e266ac72-72cc-4359-a10b-2d308e81fb84 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:39.336143 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e266ac72-72cc-4359-a10b-2d308e81fb84 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:39.342625 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e266ac72-72cc-4359-a10b-2d308e81fb84 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:39.343360 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e266ac72-72cc-4359-a10b-2d308e81fb84 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:39.343541 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e266ac72-72cc-4359-a10b-2d308e81fb84 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:39.344352 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e266ac72-72cc-4359-a10b-2d308e81fb84 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:39.344697 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e266ac72-72cc-4359-a10b-2d308e81fb84 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:39.345148 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e266ac72-72cc-4359-a10b-2d308e81fb84 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:39.472816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e266ac72-72cc-4359-a10b-2d308e81fb84 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:39.479663 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:39.481956 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e266ac72-72cc-4359-a10b-2d308e81fb84 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1314 microversion: 2.1 time: 0.150368 Sep 23 14:04:39.482548 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 160/306] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:39 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:40.502797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:40.503550 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=18 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:40.507573 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-280981a3-cf4d-4ebf-873b-2666930e61a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:40.508292 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-280981a3-cf4d-4ebf-873b-2666930e61a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:40.515298 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-280981a3-cf4d-4ebf-873b-2666930e61a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:40.515845 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-280981a3-cf4d-4ebf-873b-2666930e61a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:40.516278 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-280981a3-cf4d-4ebf-873b-2666930e61a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:40.517038 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-280981a3-cf4d-4ebf-873b-2666930e61a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:40.517491 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-280981a3-cf4d-4ebf-873b-2666930e61a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:40.517913 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-280981a3-cf4d-4ebf-873b-2666930e61a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:40.651586 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-280981a3-cf4d-4ebf-873b-2666930e61a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:40.659251 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-280981a3-cf4d-4ebf-873b-2666930e61a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1314 microversion: 2.1 time: 0.157428 Sep 23 14:04:40.659809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 147/307] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:40 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:41.682465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-15814032-cfca-41bc-af87-e518804f63a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:41.683108 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-15814032-cfca-41bc-af87-e518804f63a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:41.689629 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-15814032-cfca-41bc-af87-e518804f63a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:41.690117 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-15814032-cfca-41bc-af87-e518804f63a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:41.690582 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-15814032-cfca-41bc-af87-e518804f63a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:41.691278 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-15814032-cfca-41bc-af87-e518804f63a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:41.691749 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-15814032-cfca-41bc-af87-e518804f63a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:41.692159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-15814032-cfca-41bc-af87-e518804f63a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:41.696176 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=100 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:41.712866 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-552da793-aa93-437b-919c-1791867cbd5e req-d8e5f692-9ff3-4de3-839e-1aed70f73894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f494b01-791a-4c3d-af21-0acceb3aedec", "name": "network-vif-plugged", "status": "completed", "tag": "3dccf39d-2e29-4cc0-a163-7c174916734c"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:41.725261 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-552da793-aa93-437b-919c-1791867cbd5e req-d8e5f692-9ff3-4de3-839e-1aed70f73894 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:41.725953 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-552da793-aa93-437b-919c-1791867cbd5e req-d8e5f692-9ff3-4de3-839e-1aed70f73894 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:41.726417 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-552da793-aa93-437b-919c-1791867cbd5e req-d8e5f692-9ff3-4de3-839e-1aed70f73894 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:41.738755 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-552da793-aa93-437b-919c-1791867cbd5e req-d8e5f692-9ff3-4de3-839e-1aed70f73894 service nova] Creating event network-vif-plugged:3dccf39d-2e29-4cc0-a163-7c174916734c for instance 2f494b01-791a-4c3d-af21-0acceb3aedec on hv-cinder-85743 Sep 23 14:04:41.744611 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-552da793-aa93-437b-919c-1791867cbd5e req-d8e5f692-9ff3-4de3-839e-1aed70f73894 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035342 Sep 23 14:04:41.745180 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 148/308] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:04:41.826310 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-15814032-cfca-41bc-af87-e518804f63a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:41.833890 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-15814032-cfca-41bc-af87-e518804f63a2 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1314 microversion: 2.1 time: 0.155976 Sep 23 14:04:41.834681 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 161/309] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:41 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:42.859421 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f67af2dd-b79f-437c-8fe9-c44f63ceafbe tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:42.860108 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f67af2dd-b79f-437c-8fe9-c44f63ceafbe tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:42.866308 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f67af2dd-b79f-437c-8fe9-c44f63ceafbe tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:42.866820 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f67af2dd-b79f-437c-8fe9-c44f63ceafbe tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:42.867250 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f67af2dd-b79f-437c-8fe9-c44f63ceafbe tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:42.867927 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f67af2dd-b79f-437c-8fe9-c44f63ceafbe tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:42.868407 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f67af2dd-b79f-437c-8fe9-c44f63ceafbe tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:42.868836 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f67af2dd-b79f-437c-8fe9-c44f63ceafbe tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:43.000889 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f67af2dd-b79f-437c-8fe9-c44f63ceafbe tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:43.008343 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f67af2dd-b79f-437c-8fe9-c44f63ceafbe tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1314 microversion: 2.1 time: 0.153073 Sep 23 14:04:43.009465 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 149/310] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:42 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:44.031363 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ac2e5d62-4a0e-436b-ad03-ae307ce65baf tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:44.031982 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ac2e5d62-4a0e-436b-ad03-ae307ce65baf tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:44.038952 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ac2e5d62-4a0e-436b-ad03-ae307ce65baf tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:44.039442 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ac2e5d62-4a0e-436b-ad03-ae307ce65baf tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:44.039884 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ac2e5d62-4a0e-436b-ad03-ae307ce65baf tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:44.045089 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ac2e5d62-4a0e-436b-ad03-ae307ce65baf tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:44.045089 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ac2e5d62-4a0e-436b-ad03-ae307ce65baf tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:44.045089 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ac2e5d62-4a0e-436b-ad03-ae307ce65baf tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:44.174723 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ac2e5d62-4a0e-436b-ad03-ae307ce65baf tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:44.182510 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ac2e5d62-4a0e-436b-ad03-ae307ce65baf tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1314 microversion: 2.1 time: 0.155056 Sep 23 14:04:44.183072 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 162/311] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:44 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:45.205038 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-13c2f907-3df9-4628-9a7e-ea3456c2eee8 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:45.205747 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-13c2f907-3df9-4628-9a7e-ea3456c2eee8 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:45.211811 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-13c2f907-3df9-4628-9a7e-ea3456c2eee8 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:45.212382 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-13c2f907-3df9-4628-9a7e-ea3456c2eee8 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:45.212927 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-13c2f907-3df9-4628-9a7e-ea3456c2eee8 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:45.213615 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-13c2f907-3df9-4628-9a7e-ea3456c2eee8 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:45.214067 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-13c2f907-3df9-4628-9a7e-ea3456c2eee8 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:45.214518 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-13c2f907-3df9-4628-9a7e-ea3456c2eee8 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:45.347028 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-13c2f907-3df9-4628-9a7e-ea3456c2eee8 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:45.355067 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-13c2f907-3df9-4628-9a7e-ea3456c2eee8 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1463 microversion: 2.1 time: 0.153841 Sep 23 14:04:45.355631 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 150/312] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:45 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:04:45.401354 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1d8cb128-8bc6-48ab-8a95-850365176630 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:45.401854 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1d8cb128-8bc6-48ab-8a95-850365176630 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:45.408189 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d8cb128-8bc6-48ab-8a95-850365176630 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:45.408673 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d8cb128-8bc6-48ab-8a95-850365176630 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:45.409099 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d8cb128-8bc6-48ab-8a95-850365176630 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:45.409781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d8cb128-8bc6-48ab-8a95-850365176630 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:45.410229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d8cb128-8bc6-48ab-8a95-850365176630 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:45.410750 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d8cb128-8bc6-48ab-8a95-850365176630 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:45.439027 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1d8cb128-8bc6-48ab-8a95-850365176630 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Going to try to terminate instance {{(pid=121073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:04:45.705057 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1d8cb128-8bc6-48ab-8a95-850365176630 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 204 len: 0 microversion: 2.1 time: 0.307207 Sep 23 14:04:45.705639 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 163/313] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:04:45 2022] DELETE /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 14:04:45.714604 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-3c600511-7621-4229-b93c-7b9c0569391c tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:45.715345 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-3c600511-7621-4229-b93c-7b9c0569391c tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:45.721255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3c600511-7621-4229-b93c-7b9c0569391c tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:45.721726 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3c600511-7621-4229-b93c-7b9c0569391c tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:45.722158 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3c600511-7621-4229-b93c-7b9c0569391c tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:45.722870 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3c600511-7621-4229-b93c-7b9c0569391c tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:45.723322 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3c600511-7621-4229-b93c-7b9c0569391c tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:45.723744 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3c600511-7621-4229-b93c-7b9c0569391c tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:45.853772 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-3c600511-7621-4229-b93c-7b9c0569391c tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:45.861514 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-3c600511-7621-4229-b93c-7b9c0569391c tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1469 microversion: 2.1 time: 0.151244 Sep 23 14:04:45.862020 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 151/314] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:45 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:46.885779 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9eafcf01-0613-48c9-9582-b5e1d620b1db tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:46.886439 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9eafcf01-0613-48c9-9582-b5e1d620b1db tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:46.892737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9eafcf01-0613-48c9-9582-b5e1d620b1db tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:46.893223 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9eafcf01-0613-48c9-9582-b5e1d620b1db tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:46.893651 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9eafcf01-0613-48c9-9582-b5e1d620b1db tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:46.894347 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9eafcf01-0613-48c9-9582-b5e1d620b1db tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:46.894806 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9eafcf01-0613-48c9-9582-b5e1d620b1db tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:46.895246 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9eafcf01-0613-48c9-9582-b5e1d620b1db tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:47.023645 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9eafcf01-0613-48c9-9582-b5e1d620b1db tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:47.028957 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9eafcf01-0613-48c9-9582-b5e1d620b1db tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1469 microversion: 2.1 time: 0.147758 Sep 23 14:04:47.029618 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 164/315] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:46 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1469 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:48.053122 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9540e70e-1118-471a-8cf3-12926341f133 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:48.053730 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-9540e70e-1118-471a-8cf3-12926341f133 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:48.060252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9540e70e-1118-471a-8cf3-12926341f133 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:48.060738 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9540e70e-1118-471a-8cf3-12926341f133 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:48.061171 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9540e70e-1118-471a-8cf3-12926341f133 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:48.061858 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9540e70e-1118-471a-8cf3-12926341f133 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:48.062305 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9540e70e-1118-471a-8cf3-12926341f133 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:48.062755 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9540e70e-1118-471a-8cf3-12926341f133 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:48.194543 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9540e70e-1118-471a-8cf3-12926341f133 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:48.202401 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-9540e70e-1118-471a-8cf3-12926341f133 tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1469 microversion: 2.1 time: 0.153013 Sep 23 14:04:48.218539 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 152/316] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:48 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:48.540348 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-65bcf66b-1dfb-4fef-8408-177f4eedef3f req-b4cf58f6-6295-46c6-8cd6-bde2640d4e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f494b01-791a-4c3d-af21-0acceb3aedec", "name": "network-vif-deleted", "tag": "3dccf39d-2e29-4cc0-a163-7c174916734c"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:04:48.550658 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-65bcf66b-1dfb-4fef-8408-177f4eedef3f req-b4cf58f6-6295-46c6-8cd6-bde2640d4e27 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:48.557327 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-65bcf66b-1dfb-4fef-8408-177f4eedef3f req-b4cf58f6-6295-46c6-8cd6-bde2640d4e27 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:48.557327 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-65bcf66b-1dfb-4fef-8408-177f4eedef3f req-b4cf58f6-6295-46c6-8cd6-bde2640d4e27 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:48.562149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-65bcf66b-1dfb-4fef-8408-177f4eedef3f req-b4cf58f6-6295-46c6-8cd6-bde2640d4e27 service nova] Creating event network-vif-deleted:3dccf39d-2e29-4cc0-a163-7c174916734c for instance 2f494b01-791a-4c3d-af21-0acceb3aedec on hv-cinder-85743 Sep 23 14:04:48.566983 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-65bcf66b-1dfb-4fef-8408-177f4eedef3f req-b4cf58f6-6295-46c6-8cd6-bde2640d4e27 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030345 Sep 23 14:04:48.567600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 165/317] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:04:49.225174 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ea910a13-a590-4fbf-835f-2fceda8944fa tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:49.225794 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ea910a13-a590-4fbf-835f-2fceda8944fa tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:49.232474 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea910a13-a590-4fbf-835f-2fceda8944fa tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:49.232967 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea910a13-a590-4fbf-835f-2fceda8944fa tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:49.233407 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea910a13-a590-4fbf-835f-2fceda8944fa tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:49.234108 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea910a13-a590-4fbf-835f-2fceda8944fa tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:49.234592 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea910a13-a590-4fbf-835f-2fceda8944fa tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:49.235022 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea910a13-a590-4fbf-835f-2fceda8944fa tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:49.266531 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea910a13-a590-4fbf-835f-2fceda8944fa tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:49.267151 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea910a13-a590-4fbf-835f-2fceda8944fa tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:49.267590 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea910a13-a590-4fbf-835f-2fceda8944fa tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:49.268047 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-ea910a13-a590-4fbf-835f-2fceda8944fa tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lazy-loading 'fault' on Instance uuid 2f494b01-791a-4c3d-af21-0acceb3aedec {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:04:49.312525 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ea910a13-a590-4fbf-835f-2fceda8944fa tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4de1df05f09452fa54a560f1934b62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f795f5f1a0541e28e28c4fc48877888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:04:49.320104 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ea910a13-a590-4fbf-835f-2fceda8944fa tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 200 len: 1304 microversion: 2.1 time: 0.098881 Sep 23 14:04:49.320658 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 153/318] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:49 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:04:50.344523 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d7eb1b36-257f-4c29-a102-d0c3ba5dce6b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:04:50.345210 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d7eb1b36-257f-4c29-a102-d0c3ba5dce6b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] [instance: 2f494b01-791a-4c3d-af21-0acceb3aedec] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:04:50.347170 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:50.352148 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d7eb1b36-257f-4c29-a102-d0c3ba5dce6b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:50.352641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d7eb1b36-257f-4c29-a102-d0c3ba5dce6b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:50.353078 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d7eb1b36-257f-4c29-a102-d0c3ba5dce6b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:50.353766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d7eb1b36-257f-4c29-a102-d0c3ba5dce6b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:04:50.354226 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d7eb1b36-257f-4c29-a102-d0c3ba5dce6b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:04:50.354702 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d7eb1b36-257f-4c29-a102-d0c3ba5dce6b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:04:50.367692 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-d7eb1b36-257f-4c29-a102-d0c3ba5dce6b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] HTTP exception thrown: Instance 2f494b01-791a-4c3d-af21-0acceb3aedec could not be found. Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d7eb1b36-257f-4c29-a102-d0c3ba5dce6b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Request method failure captured: Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec HTTP/1.1 Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbzqJtZri3jbqJwVNrzOSVbq_Ya5O5jRX2ljc5OYXz6QRvqBEfJaSNnb6pPa8lrekACTxd6DvzjuJZGuWjYkJ-m_tB-NwiSXtFM6acOPhz2q8e1fhWMk1mJS5xfmPNdvUydX4e8uzDJoPvzYyx2Kiu4kpCDTbzfKlwWbcv7USLvzXzI Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 8f795f5f1a0541e28e28c4fc48877888 Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-VolumesNegativeTest-475273187 Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:04:50.369288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:04:50.371389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8f795f5f1a0541e28e28c4fc48877888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8f795f5f1a0541e28e28c4fc48877888"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8f795f5f1a0541e28e28c4fc48877888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8f795f5f1a0541e28e28c4fc48877888"}]}] Sep 23 14:04:50.371389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-VolumesNegativeTest-475273187 Sep 23 14:04:50.371389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 8f795f5f1a0541e28e28c4fc48877888 Sep 23 14:04:50.371389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-VolumesNegativeTest-475273187 Sep 23 14:04:50.371389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-VolumesNegativeTest-475273187-project Sep 23 14:04:50.371389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:04:50.371389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:04:50.371389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: e4de1df05f09452fa54a560f1934b62d Sep 23 14:04:50.371389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-VolumesNegativeTest-475273187-project Sep 23 14:04:50.371389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:04:50.371389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 2f494b01-791a-4c3d-af21-0acceb3aedec could not be found. Sep 23 14:04:50.371389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '2f494b01-791a-4c3d-af21-0acceb3aedec'} Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f494b01-791a-4c3d-af21-0acceb3aedec could not be found. Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:04:50.372319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f494b01-791a-4c3d-af21-0acceb3aedec could not be found. Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f494b01-791a-4c3d-af21-0acceb3aedec could not be found. Sep 23 14:04:50.373516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:04:50.374656 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d7eb1b36-257f-4c29-a102-d0c3ba5dce6b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] Returning 404 to user: Instance 2f494b01-791a-4c3d-af21-0acceb3aedec could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:04:50.374656 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d7eb1b36-257f-4c29-a102-d0c3ba5dce6b tempest-VolumesNegativeTest-475273187 tempest-VolumesNegativeTest-475273187-project] 10.222.0.62 "GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec" status: 404 len: 111 microversion: 2.1 time: 0.031711 Sep 23 14:04:50.374656 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 166/319] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:04:50 2022] GET /compute/v2.1/servers/2f494b01-791a-4c3d-af21-0acceb3aedec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:05:08.324042 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-2b8e3bf1-e2b6-420f-8ae0-afc0984d7412 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:08.324579 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-2b8e3bf1-e2b6-420f-8ae0-afc0984d7412 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:08.326803 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=35 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:08.327444 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=69 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:08.332075 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2b8e3bf1-e2b6-420f-8ae0-afc0984d7412 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:08.332552 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2b8e3bf1-e2b6-420f-8ae0-afc0984d7412 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:08.332983 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2b8e3bf1-e2b6-420f-8ae0-afc0984d7412 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:08.333707 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2b8e3bf1-e2b6-420f-8ae0-afc0984d7412 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:08.334153 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2b8e3bf1-e2b6-420f-8ae0-afc0984d7412 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:08.334606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2b8e3bf1-e2b6-420f-8ae0-afc0984d7412 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:08.357758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-2b8e3bf1-e2b6-420f-8ae0-afc0984d7412 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/ips" status: 200 len: 153 microversion: 2.20 time: 0.037736 Sep 23 14:05:08.358311 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 154/320] 10.222.0.62 () {60 vars in 1289 bytes} [Fri Sep 23 14:05:08 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 14:05:14.201354 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9eeb883e-63f9-45f8-a02f-50988ae457bd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:05:14.201913 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9eeb883e-63f9-45f8-a02f-50988ae457bd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:14.204150 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:14.213374 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9eeb883e-63f9-45f8-a02f-50988ae457bd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:14.213374 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9eeb883e-63f9-45f8-a02f-50988ae457bd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:14.213374 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9eeb883e-63f9-45f8-a02f-50988ae457bd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:14.213374 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9eeb883e-63f9-45f8-a02f-50988ae457bd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:14.213822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9eeb883e-63f9-45f8-a02f-50988ae457bd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:14.214503 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9eeb883e-63f9-45f8-a02f-50988ae457bd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:14.240036 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-9eeb883e-63f9-45f8-a02f-50988ae457bd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lazy-loading 'flavor' on Instance uuid 97557fbe-c1f4-464e-93b8-3c71fbc48936 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:05:14.724122 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9eeb883e-63f9-45f8-a02f-50988ae457bd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "POST /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/action" status: 202 len: 0 microversion: 2.20 time: 0.526719 Sep 23 14:05:14.724714 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 167/321] 10.222.0.62 () {62 vars in 1319 bytes} [Fri Sep 23 14:05:14 2022] POST /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 23 14:05:14.732877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-837f0216-ec59-416c-a36e-623374099bf1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:14.733484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-837f0216-ec59-416c-a36e-623374099bf1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:14.740879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-837f0216-ec59-416c-a36e-623374099bf1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:14.741371 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-837f0216-ec59-416c-a36e-623374099bf1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:14.741807 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-837f0216-ec59-416c-a36e-623374099bf1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:14.742530 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-837f0216-ec59-416c-a36e-623374099bf1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:14.742987 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-837f0216-ec59-416c-a36e-623374099bf1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:14.743411 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-837f0216-ec59-416c-a36e-623374099bf1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:14.875774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-837f0216-ec59-416c-a36e-623374099bf1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:14.883861 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-837f0216-ec59-416c-a36e-623374099bf1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:14.885302 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-837f0216-ec59-416c-a36e-623374099bf1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:14.886476 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-837f0216-ec59-416c-a36e-623374099bf1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.157487 Sep 23 14:05:14.887033 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 155/322] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:14 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:15.913283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-01fe9039-926e-4b22-b423-c6f8f2975a20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:15.913976 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-01fe9039-926e-4b22-b423-c6f8f2975a20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:15.920410 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-01fe9039-926e-4b22-b423-c6f8f2975a20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:15.920920 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-01fe9039-926e-4b22-b423-c6f8f2975a20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:15.921357 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-01fe9039-926e-4b22-b423-c6f8f2975a20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:15.922034 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-01fe9039-926e-4b22-b423-c6f8f2975a20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:15.922518 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-01fe9039-926e-4b22-b423-c6f8f2975a20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:15.922939 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-01fe9039-926e-4b22-b423-c6f8f2975a20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:16.053506 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-01fe9039-926e-4b22-b423-c6f8f2975a20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:16.061420 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-01fe9039-926e-4b22-b423-c6f8f2975a20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:16.062887 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-01fe9039-926e-4b22-b423-c6f8f2975a20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:16.064032 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-01fe9039-926e-4b22-b423-c6f8f2975a20 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.155658 Sep 23 14:05:16.064578 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 168/323] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:15 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:17.089676 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a0196960-e150-40a8-9d19-435e7bccd218 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:17.090464 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a0196960-e150-40a8-9d19-435e7bccd218 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:17.096350 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a0196960-e150-40a8-9d19-435e7bccd218 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:17.096831 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a0196960-e150-40a8-9d19-435e7bccd218 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:17.097263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a0196960-e150-40a8-9d19-435e7bccd218 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:17.097948 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a0196960-e150-40a8-9d19-435e7bccd218 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:17.098421 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a0196960-e150-40a8-9d19-435e7bccd218 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:17.098844 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a0196960-e150-40a8-9d19-435e7bccd218 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:17.231013 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a0196960-e150-40a8-9d19-435e7bccd218 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:17.239148 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a0196960-e150-40a8-9d19-435e7bccd218 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:17.241338 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a0196960-e150-40a8-9d19-435e7bccd218 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:17.242538 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a0196960-e150-40a8-9d19-435e7bccd218 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.156740 Sep 23 14:05:17.243109 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 156/324] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:17 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:18.269249 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-72936a16-534a-4041-bce0-756c45fe98e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:18.269852 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-72936a16-534a-4041-bce0-756c45fe98e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:18.277301 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-72936a16-534a-4041-bce0-756c45fe98e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:18.277792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-72936a16-534a-4041-bce0-756c45fe98e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:18.278232 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-72936a16-534a-4041-bce0-756c45fe98e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:18.278957 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-72936a16-534a-4041-bce0-756c45fe98e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:18.279413 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-72936a16-534a-4041-bce0-756c45fe98e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:18.279841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-72936a16-534a-4041-bce0-756c45fe98e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:18.411577 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-72936a16-534a-4041-bce0-756c45fe98e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:18.420004 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-72936a16-534a-4041-bce0-756c45fe98e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:18.421446 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-72936a16-534a-4041-bce0-756c45fe98e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:18.422626 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-72936a16-534a-4041-bce0-756c45fe98e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.157430 Sep 23 14:05:18.423179 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 169/325] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:18 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:19.448337 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-51c51cdf-8f1e-4639-98ec-183f23507cc9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:19.448877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-51c51cdf-8f1e-4639-98ec-183f23507cc9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:19.455096 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-51c51cdf-8f1e-4639-98ec-183f23507cc9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:19.455655 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-51c51cdf-8f1e-4639-98ec-183f23507cc9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:19.456083 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-51c51cdf-8f1e-4639-98ec-183f23507cc9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:19.456845 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-51c51cdf-8f1e-4639-98ec-183f23507cc9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:19.457206 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-51c51cdf-8f1e-4639-98ec-183f23507cc9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:19.457625 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-51c51cdf-8f1e-4639-98ec-183f23507cc9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:19.586919 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-51c51cdf-8f1e-4639-98ec-183f23507cc9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:19.595383 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-51c51cdf-8f1e-4639-98ec-183f23507cc9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:19.596782 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-51c51cdf-8f1e-4639-98ec-183f23507cc9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:19.597936 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-51c51cdf-8f1e-4639-98ec-183f23507cc9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.153665 Sep 23 14:05:19.598519 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 157/326] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:19 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:20.624716 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-03b63c84-e6fd-4868-a6a7-4df372b7e249 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:20.625331 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-03b63c84-e6fd-4868-a6a7-4df372b7e249 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:20.631687 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03b63c84-e6fd-4868-a6a7-4df372b7e249 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:20.632175 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03b63c84-e6fd-4868-a6a7-4df372b7e249 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:20.632616 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03b63c84-e6fd-4868-a6a7-4df372b7e249 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:20.633340 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03b63c84-e6fd-4868-a6a7-4df372b7e249 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:20.633794 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03b63c84-e6fd-4868-a6a7-4df372b7e249 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:20.634218 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03b63c84-e6fd-4868-a6a7-4df372b7e249 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:20.772710 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-03b63c84-e6fd-4868-a6a7-4df372b7e249 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:20.780796 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-03b63c84-e6fd-4868-a6a7-4df372b7e249 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:20.782238 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-03b63c84-e6fd-4868-a6a7-4df372b7e249 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:20.783430 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-03b63c84-e6fd-4868-a6a7-4df372b7e249 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.162866 Sep 23 14:05:20.783985 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 170/327] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:20 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:21.809403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-05327103-de48-4370-b023-cb5b0c52b5e0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:21.810024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-05327103-de48-4370-b023-cb5b0c52b5e0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:21.817381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-05327103-de48-4370-b023-cb5b0c52b5e0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:21.817913 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-05327103-de48-4370-b023-cb5b0c52b5e0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:21.818399 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-05327103-de48-4370-b023-cb5b0c52b5e0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:21.819685 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-05327103-de48-4370-b023-cb5b0c52b5e0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:21.820163 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-05327103-de48-4370-b023-cb5b0c52b5e0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:21.820599 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-05327103-de48-4370-b023-cb5b0c52b5e0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:21.950790 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-05327103-de48-4370-b023-cb5b0c52b5e0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:21.958780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-05327103-de48-4370-b023-cb5b0c52b5e0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:21.960683 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-05327103-de48-4370-b023-cb5b0c52b5e0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:21.961909 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-05327103-de48-4370-b023-cb5b0c52b5e0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.156508 Sep 23 14:05:21.962486 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 158/328] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:21 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:22.986686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-42311d58-0d83-4ab9-9510-34e6a233f8bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:22.987328 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-42311d58-0d83-4ab9-9510-34e6a233f8bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:22.993804 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-42311d58-0d83-4ab9-9510-34e6a233f8bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:22.994272 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-42311d58-0d83-4ab9-9510-34e6a233f8bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:22.994739 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-42311d58-0d83-4ab9-9510-34e6a233f8bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:22.995425 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-42311d58-0d83-4ab9-9510-34e6a233f8bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:22.995881 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-42311d58-0d83-4ab9-9510-34e6a233f8bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:22.996306 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-42311d58-0d83-4ab9-9510-34e6a233f8bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:23.145853 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-42311d58-0d83-4ab9-9510-34e6a233f8bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:23.155931 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-42311d58-0d83-4ab9-9510-34e6a233f8bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:23.157493 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-42311d58-0d83-4ab9-9510-34e6a233f8bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:23.158779 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-42311d58-0d83-4ab9-9510-34e6a233f8bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.176105 Sep 23 14:05:23.159375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 171/329] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:22 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:24.195713 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-09cd5154-9a24-405d-a964-b59122a141c4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:24.195713 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-09cd5154-9a24-405d-a964-b59122a141c4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:24.206254 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-09cd5154-9a24-405d-a964-b59122a141c4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:24.206894 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-09cd5154-9a24-405d-a964-b59122a141c4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:24.207962 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-09cd5154-9a24-405d-a964-b59122a141c4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:24.208868 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-09cd5154-9a24-405d-a964-b59122a141c4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:24.210602 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-09cd5154-9a24-405d-a964-b59122a141c4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:24.211414 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-09cd5154-9a24-405d-a964-b59122a141c4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:24.365978 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-09cd5154-9a24-405d-a964-b59122a141c4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:24.374601 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-09cd5154-9a24-405d-a964-b59122a141c4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:24.376264 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-09cd5154-9a24-405d-a964-b59122a141c4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:24.377555 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-09cd5154-9a24-405d-a964-b59122a141c4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.189730 Sep 23 14:05:24.382393 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 159/330] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:24 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:25.404750 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f7f96d7b-bb6a-43f6-aee0-3719ff15ab36 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:25.406026 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f7f96d7b-bb6a-43f6-aee0-3719ff15ab36 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:25.421596 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7f96d7b-bb6a-43f6-aee0-3719ff15ab36 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:25.423105 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7f96d7b-bb6a-43f6-aee0-3719ff15ab36 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:25.429183 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7f96d7b-bb6a-43f6-aee0-3719ff15ab36 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:25.429183 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7f96d7b-bb6a-43f6-aee0-3719ff15ab36 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:25.429183 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7f96d7b-bb6a-43f6-aee0-3719ff15ab36 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:25.429183 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7f96d7b-bb6a-43f6-aee0-3719ff15ab36 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:25.588736 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f7f96d7b-bb6a-43f6-aee0-3719ff15ab36 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:25.602485 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f7f96d7b-bb6a-43f6-aee0-3719ff15ab36 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:25.607384 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f7f96d7b-bb6a-43f6-aee0-3719ff15ab36 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:25.608044 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f7f96d7b-bb6a-43f6-aee0-3719ff15ab36 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.206784 Sep 23 14:05:25.610721 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 172/331] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:25 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:26.634254 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d22a8d6b-5672-4ef0-8bf5-03d8f08e3230 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:26.634914 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d22a8d6b-5672-4ef0-8bf5-03d8f08e3230 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:26.641448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d22a8d6b-5672-4ef0-8bf5-03d8f08e3230 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:26.641962 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d22a8d6b-5672-4ef0-8bf5-03d8f08e3230 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:26.642449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d22a8d6b-5672-4ef0-8bf5-03d8f08e3230 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:26.643177 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d22a8d6b-5672-4ef0-8bf5-03d8f08e3230 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:26.643658 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d22a8d6b-5672-4ef0-8bf5-03d8f08e3230 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:26.644082 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d22a8d6b-5672-4ef0-8bf5-03d8f08e3230 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:26.784231 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d22a8d6b-5672-4ef0-8bf5-03d8f08e3230 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:26.792391 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d22a8d6b-5672-4ef0-8bf5-03d8f08e3230 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:26.793833 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d22a8d6b-5672-4ef0-8bf5-03d8f08e3230 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:26.795271 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d22a8d6b-5672-4ef0-8bf5-03d8f08e3230 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.165349 Sep 23 14:05:26.795825 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 160/332] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:26 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:27.262094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e9b7a002-422c-47eb-93f4-269fa223bfef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:27.262569 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e9b7a002-422c-47eb-93f4-269fa223bfef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:27.269038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9b7a002-422c-47eb-93f4-269fa223bfef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:27.269541 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9b7a002-422c-47eb-93f4-269fa223bfef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:27.269975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9b7a002-422c-47eb-93f4-269fa223bfef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:27.270698 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9b7a002-422c-47eb-93f4-269fa223bfef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:27.271311 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9b7a002-422c-47eb-93f4-269fa223bfef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:27.271768 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9b7a002-422c-47eb-93f4-269fa223bfef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:27.297610 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e9b7a002-422c-47eb-93f4-269fa223bfef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae/ips" status: 200 len: 150 microversion: 2.1 time: 0.039971 Sep 23 14:05:27.301439 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 173/333] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 23 14:05:27 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:05:27.314774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e56abde7-f23c-4189-8160-934761d7ddaf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0c380be-bbfd-4dd0-abe0-e09ff5c7f090"}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:05:27.317207 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e56abde7-f23c-4189-8160-934761d7ddaf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:27.330450 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e56abde7-f23c-4189-8160-934761d7ddaf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:27.333335 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e56abde7-f23c-4189-8160-934761d7ddaf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:27.340229 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e56abde7-f23c-4189-8160-934761d7ddaf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:27.341152 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e56abde7-f23c-4189-8160-934761d7ddaf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:27.341787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e56abde7-f23c-4189-8160-934761d7ddaf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:27.342397 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e56abde7-f23c-4189-8160-934761d7ddaf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:27.443558 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-e56abde7-f23c-4189-8160-934761d7ddaf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] HTTP exception thrown: Invalid volume: volume c0c380be-bbfd-4dd0-abe0-e09ff5c7f090 is already attached to instances: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e56abde7-f23c-4189-8160-934761d7ddaf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Request method failure captured: Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: POST /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae/os-volume_attachments HTTP/1.1 Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 74 Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxrzANyu0HiE-RI6YrwV4d8fV10ylWEIATegCXV8WUB95m5oAKUEypeFaRSmFIPzbJ8OQMl6Aud1_-7wjU4ZO6GDRxJPylRi9sW9fsJGE2eeMrNRP5hVeqDi3IdZCENn82q0KEmt_9wVferpVh22qvGQNXZFPNp1vMViuNoGirJUN4 Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:05:27.445667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:05:27.452166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_482490c45ac64607bba9ad021f2effbf"}]}] Sep 23 14:05:27.452166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:05:27.452166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:05:27.452166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:05:27.452166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:05:27.452166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:05:27.452166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:05:27.452166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 0db30f990aae49fabf9b8b19cd019de9 Sep 23 14:05:27.452166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:05:27.452166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Sep 23 14:05:27.452166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {"volumeAttachment": {"volumeId": "c0c380be-bbfd-4dd0-abe0-e09ff5c7f090"}} Sep 23 14:05:27.452166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Invalid volume: volume c0c380be-bbfd-4dd0-abe0-e09ff5c7f090 is already attached to instances: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'server_id': '760e9fcc-3723-43bd-ab9b-db54f81db1ae', 'body': {'volumeAttachment': {'volumeId': 'c0c380be-bbfd-4dd0-abe0-e09ff5c7f090'}}} Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c0c380be-bbfd-4dd0-abe0-e09ff5c7f090 is already attached to instances: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:05:27.453088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c0c380be-bbfd-4dd0-abe0-e09ff5c7f090 is already attached to instances: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:05:27.454506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:05:27.455891 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:05:27.455891 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:05:27.455891 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:05:27.455891 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c0c380be-bbfd-4dd0-abe0-e09ff5c7f090 is already attached to instances: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b Sep 23 14:05:27.455891 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:05:27.455891 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e56abde7-f23c-4189-8160-934761d7ddaf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Returning 400 to user: Invalid volume: volume c0c380be-bbfd-4dd0-abe0-e09ff5c7f090 is already attached to instances: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:05:27.455891 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e56abde7-f23c-4189-8160-934761d7ddaf tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "POST /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.137212 Sep 23 14:05:27.455891 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 161/334] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 23 14:05:27 2022] POST /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae/os-volume_attachments => generated 174 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 14:05:27.462099 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-7242ce2a-fa8a-4dd3-8a61-9ea9e2b6730c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:27.462628 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-7242ce2a-fa8a-4dd3-8a61-9ea9e2b6730c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:27.468692 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7242ce2a-fa8a-4dd3-8a61-9ea9e2b6730c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:27.469334 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7242ce2a-fa8a-4dd3-8a61-9ea9e2b6730c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:27.469656 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7242ce2a-fa8a-4dd3-8a61-9ea9e2b6730c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:27.470398 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7242ce2a-fa8a-4dd3-8a61-9ea9e2b6730c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:27.470860 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7242ce2a-fa8a-4dd3-8a61-9ea9e2b6730c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:27.471289 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7242ce2a-fa8a-4dd3-8a61-9ea9e2b6730c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:27.497717 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-7242ce2a-fa8a-4dd3-8a61-9ea9e2b6730c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Going to try to terminate instance {{(pid=121073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:05:27.820826 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f4152023-5676-40a4-b63c-8b625ba0aebe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:27.821432 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f4152023-5676-40a4-b63c-8b625ba0aebe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:27.828345 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f4152023-5676-40a4-b63c-8b625ba0aebe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:27.829093 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f4152023-5676-40a4-b63c-8b625ba0aebe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:27.829756 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f4152023-5676-40a4-b63c-8b625ba0aebe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:27.830699 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f4152023-5676-40a4-b63c-8b625ba0aebe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:27.831349 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f4152023-5676-40a4-b63c-8b625ba0aebe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:27.831961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f4152023-5676-40a4-b63c-8b625ba0aebe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:27.833795 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-7242ce2a-fa8a-4dd3-8a61-9ea9e2b6730c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 204 len: 0 microversion: 2.1 time: 0.375929 Sep 23 14:05:27.835641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 174/335] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:05:27 2022] DELETE /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:05:27.844971 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-486e9019-8132-4ed3-812f-17cd7d579bce tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:27.845746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-486e9019-8132-4ed3-812f-17cd7d579bce tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:27.855468 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-486e9019-8132-4ed3-812f-17cd7d579bce tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:27.856804 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-486e9019-8132-4ed3-812f-17cd7d579bce tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:27.859821 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-486e9019-8132-4ed3-812f-17cd7d579bce tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:27.860736 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-486e9019-8132-4ed3-812f-17cd7d579bce tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:27.861356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-486e9019-8132-4ed3-812f-17cd7d579bce tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:27.862358 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-486e9019-8132-4ed3-812f-17cd7d579bce tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:28.139209 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-486e9019-8132-4ed3-812f-17cd7d579bce tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:28.147234 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-486e9019-8132-4ed3-812f-17cd7d579bce tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1681 microversion: 2.1 time: 0.306503 Sep 23 14:05:28.148306 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 175/336] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:27 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1681 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:05:28.148605 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f4152023-5676-40a4-b63c-8b625ba0aebe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:28.160929 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f4152023-5676-40a4-b63c-8b625ba0aebe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:28.166396 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f4152023-5676-40a4-b63c-8b625ba0aebe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:28.166396 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f4152023-5676-40a4-b63c-8b625ba0aebe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.346960 Sep 23 14:05:28.166396 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 162/337] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:27 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:05:29.173955 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-63301f75-c4d8-46b0-b47d-98ff7dacc120 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:29.174604 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-63301f75-c4d8-46b0-b47d-98ff7dacc120 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:29.187335 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-63301f75-c4d8-46b0-b47d-98ff7dacc120 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:29.189587 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-63301f75-c4d8-46b0-b47d-98ff7dacc120 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:29.190263 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-63301f75-c4d8-46b0-b47d-98ff7dacc120 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:29.192390 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d94f8e7d-ce19-406a-83bc-494e4b941100 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:29.192898 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-63301f75-c4d8-46b0-b47d-98ff7dacc120 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:29.193788 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d94f8e7d-ce19-406a-83bc-494e4b941100 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:29.195764 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-63301f75-c4d8-46b0-b47d-98ff7dacc120 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:29.196637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-63301f75-c4d8-46b0-b47d-98ff7dacc120 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:29.213066 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d94f8e7d-ce19-406a-83bc-494e4b941100 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:29.216886 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d94f8e7d-ce19-406a-83bc-494e4b941100 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:29.217999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d94f8e7d-ce19-406a-83bc-494e4b941100 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:29.219034 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d94f8e7d-ce19-406a-83bc-494e4b941100 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:29.219740 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d94f8e7d-ce19-406a-83bc-494e4b941100 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:29.220408 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d94f8e7d-ce19-406a-83bc-494e4b941100 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:29.501121 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-63301f75-c4d8-46b0-b47d-98ff7dacc120 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:29.511027 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-63301f75-c4d8-46b0-b47d-98ff7dacc120 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1681 microversion: 2.1 time: 0.342409 Sep 23 14:05:29.511695 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 176/338] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:29 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1681 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:29.532935 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d94f8e7d-ce19-406a-83bc-494e4b941100 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:29.541462 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d94f8e7d-ce19-406a-83bc-494e4b941100 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:29.545668 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d94f8e7d-ce19-406a-83bc-494e4b941100 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:29.548573 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d94f8e7d-ce19-406a-83bc-494e4b941100 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.360593 Sep 23 14:05:29.550113 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 163/339] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:29 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:05:30.536130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d7cf94b5-76ff-4f19-83e6-4b09aba10077 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:30.537353 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d7cf94b5-76ff-4f19-83e6-4b09aba10077 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:30.544764 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d7cf94b5-76ff-4f19-83e6-4b09aba10077 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:30.545543 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d7cf94b5-76ff-4f19-83e6-4b09aba10077 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:30.546041 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d7cf94b5-76ff-4f19-83e6-4b09aba10077 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:30.546845 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d7cf94b5-76ff-4f19-83e6-4b09aba10077 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:30.547308 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d7cf94b5-76ff-4f19-83e6-4b09aba10077 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:30.547921 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d7cf94b5-76ff-4f19-83e6-4b09aba10077 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:30.577120 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b85c862a-851e-4509-8934-50b74a0255a4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:30.578759 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b85c862a-851e-4509-8934-50b74a0255a4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:30.587036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b85c862a-851e-4509-8934-50b74a0255a4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:30.587780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b85c862a-851e-4509-8934-50b74a0255a4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:30.588593 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b85c862a-851e-4509-8934-50b74a0255a4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:30.589626 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b85c862a-851e-4509-8934-50b74a0255a4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:30.590417 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b85c862a-851e-4509-8934-50b74a0255a4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:30.591852 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b85c862a-851e-4509-8934-50b74a0255a4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:30.645425 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d7cf94b5-76ff-4f19-83e6-4b09aba10077 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:30.657970 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d7cf94b5-76ff-4f19-83e6-4b09aba10077 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1613 microversion: 2.1 time: 0.125540 Sep 23 14:05:30.658587 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 177/340] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:30 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1613 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:30.877774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b85c862a-851e-4509-8934-50b74a0255a4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:30.896493 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b85c862a-851e-4509-8934-50b74a0255a4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:30.898309 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b85c862a-851e-4509-8934-50b74a0255a4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:30.899622 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b85c862a-851e-4509-8934-50b74a0255a4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.326715 Sep 23 14:05:30.923694 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 164/341] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:30 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:05:30.946158 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-ccca18c3-c839-478a-a596-0162891199cf req-8bd0244b-9632-4bca-9a46-ba0199c9f3aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760e9fcc-3723-43bd-ab9b-db54f81db1ae", "name": "network-vif-deleted", "tag": "c01d1346-01d1-4da4-84a3-b81e410d1f69"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:05:30.957606 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-ccca18c3-c839-478a-a596-0162891199cf req-8bd0244b-9632-4bca-9a46-ba0199c9f3aa service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:30.958095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-ccca18c3-c839-478a-a596-0162891199cf req-8bd0244b-9632-4bca-9a46-ba0199c9f3aa service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:30.958726 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-ccca18c3-c839-478a-a596-0162891199cf req-8bd0244b-9632-4bca-9a46-ba0199c9f3aa service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:30.971530 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-ccca18c3-c839-478a-a596-0162891199cf req-8bd0244b-9632-4bca-9a46-ba0199c9f3aa service nova] Creating event network-vif-deleted:c01d1346-01d1-4da4-84a3-b81e410d1f69 for instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae on hv-cinder-85743 Sep 23 14:05:30.978619 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-ccca18c3-c839-478a-a596-0162891199cf req-8bd0244b-9632-4bca-9a46-ba0199c9f3aa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037835 Sep 23 14:05:30.982883 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 178/342] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:05:31.691235 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0e484cbf-a486-4e2b-80ec-638afef1fa18 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:31.699928 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-0e484cbf-a486-4e2b-80ec-638afef1fa18 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:31.704041 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e484cbf-a486-4e2b-80ec-638afef1fa18 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:31.705893 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e484cbf-a486-4e2b-80ec-638afef1fa18 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:31.706583 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e484cbf-a486-4e2b-80ec-638afef1fa18 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:31.708673 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e484cbf-a486-4e2b-80ec-638afef1fa18 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:31.709301 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e484cbf-a486-4e2b-80ec-638afef1fa18 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:31.711022 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e484cbf-a486-4e2b-80ec-638afef1fa18 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:31.791165 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e484cbf-a486-4e2b-80ec-638afef1fa18 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:31.791657 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e484cbf-a486-4e2b-80ec-638afef1fa18 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:31.792094 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e484cbf-a486-4e2b-80ec-638afef1fa18 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:31.792550 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-0e484cbf-a486-4e2b-80ec-638afef1fa18 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lazy-loading 'fault' on Instance uuid 760e9fcc-3723-43bd-ab9b-db54f81db1ae {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:05:31.872335 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-0e484cbf-a486-4e2b-80ec-638afef1fa18 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:31.884318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-0e484cbf-a486-4e2b-80ec-638afef1fa18 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1330 microversion: 2.1 time: 0.199065 Sep 23 14:05:31.886004 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 165/343] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:31 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1330 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:31.938779 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5274ec69-e4b9-4187-8ca0-c34653a046bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:31.946055 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5274ec69-e4b9-4187-8ca0-c34653a046bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:31.948635 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5274ec69-e4b9-4187-8ca0-c34653a046bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:31.949310 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5274ec69-e4b9-4187-8ca0-c34653a046bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:31.949911 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5274ec69-e4b9-4187-8ca0-c34653a046bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:31.951014 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5274ec69-e4b9-4187-8ca0-c34653a046bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:31.951638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5274ec69-e4b9-4187-8ca0-c34653a046bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:31.952215 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5274ec69-e4b9-4187-8ca0-c34653a046bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:32.134156 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5274ec69-e4b9-4187-8ca0-c34653a046bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:32.154187 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5274ec69-e4b9-4187-8ca0-c34653a046bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:32.156439 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5274ec69-e4b9-4187-8ca0-c34653a046bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:32.158959 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5274ec69-e4b9-4187-8ca0-c34653a046bf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1746 microversion: 2.20 time: 0.225057 Sep 23 14:05:32.160342 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 179/344] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:31 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1746 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:32.913808 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ea436e7b-de58-4df7-b24d-722f941c3d3b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:32.916662 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ea436e7b-de58-4df7-b24d-722f941c3d3b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:32.931686 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea436e7b-de58-4df7-b24d-722f941c3d3b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:32.931686 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea436e7b-de58-4df7-b24d-722f941c3d3b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:32.931686 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea436e7b-de58-4df7-b24d-722f941c3d3b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:32.931686 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea436e7b-de58-4df7-b24d-722f941c3d3b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:32.932042 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea436e7b-de58-4df7-b24d-722f941c3d3b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:32.932042 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea436e7b-de58-4df7-b24d-722f941c3d3b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:32.993889 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea436e7b-de58-4df7-b24d-722f941c3d3b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:32.994878 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea436e7b-de58-4df7-b24d-722f941c3d3b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:32.995478 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ea436e7b-de58-4df7-b24d-722f941c3d3b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:32.996354 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-ea436e7b-de58-4df7-b24d-722f941c3d3b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lazy-loading 'fault' on Instance uuid 760e9fcc-3723-43bd-ab9b-db54f81db1ae {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:05:32.997579 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-7908cc31-6164-47b0-85e9-dfc40ea0bd6a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5cd9758-d1cd-44b9-a39b-2115a07e981a"}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:05:33.000095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-7908cc31-6164-47b0-85e9-dfc40ea0bd6a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:33.014731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7908cc31-6164-47b0-85e9-dfc40ea0bd6a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:33.018946 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7908cc31-6164-47b0-85e9-dfc40ea0bd6a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:33.019590 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7908cc31-6164-47b0-85e9-dfc40ea0bd6a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:33.020476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7908cc31-6164-47b0-85e9-dfc40ea0bd6a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:33.023141 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7908cc31-6164-47b0-85e9-dfc40ea0bd6a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:33.027677 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7908cc31-6164-47b0-85e9-dfc40ea0bd6a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:33.057346 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ea436e7b-de58-4df7-b24d-722f941c3d3b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:33.079424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ea436e7b-de58-4df7-b24d-722f941c3d3b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 200 len: 1330 microversion: 2.1 time: 0.170599 Sep 23 14:05:33.080855 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 166/345] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:32 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 1330 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:33.187085 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d02e08ab-384a-4f11-bd7f-735e85cb9ca2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:33.187704 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d02e08ab-384a-4f11-bd7f-735e85cb9ca2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:33.202776 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d02e08ab-384a-4f11-bd7f-735e85cb9ca2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:33.202776 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d02e08ab-384a-4f11-bd7f-735e85cb9ca2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:33.202776 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d02e08ab-384a-4f11-bd7f-735e85cb9ca2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:33.207480 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d02e08ab-384a-4f11-bd7f-735e85cb9ca2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:33.207975 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d02e08ab-384a-4f11-bd7f-735e85cb9ca2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:33.217464 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d02e08ab-384a-4f11-bd7f-735e85cb9ca2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:33.222899 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:33.429860 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d02e08ab-384a-4f11-bd7f-735e85cb9ca2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:33.445402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d02e08ab-384a-4f11-bd7f-735e85cb9ca2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:33.447243 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d02e08ab-384a-4f11-bd7f-735e85cb9ca2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:33.449575 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d02e08ab-384a-4f11-bd7f-735e85cb9ca2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1741 microversion: 2.20 time: 0.265730 Sep 23 14:05:33.449704 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 167/346] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:33 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1741 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:05:34.323850 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-619e8ba5-43d6-4b4c-86b3-51b2bb4c3c9b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Action: 'create', calling method: .version_select at 0x7f9083d56ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1589397812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZcvS6lbpj9kKRJVKgfnLENcKo0gTZvPRqOw0KBin1oKKPTDhRLDZRRaifQ+JL6U3mw+LZrCY2dDJrmRGWmYwnSNOvxBd6a2/JtEssd7eXV1tECFD6nqeX9Og5W6orJuw=="}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:05:34.340732 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-7908cc31-6164-47b0-85e9-dfc40ea0bd6a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "POST /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.348463 Sep 23 14:05:34.344530 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 180/347] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 23 14:05:32 2022] POST /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-volume_attachments => generated 194 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:05:34.355309 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9b469dcc-4e3f-477d-b0b0-80b9b9edf7ff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:34.361600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9b469dcc-4e3f-477d-b0b0-80b9b9edf7ff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:34.372835 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-619e8ba5-43d6-4b4c-86b3-51b2bb4c3c9b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Getting quotas for project 728460a287914347b74cfe886f56ee6c. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:05:34.374728 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9b469dcc-4e3f-477d-b0b0-80b9b9edf7ff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:34.375946 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9b469dcc-4e3f-477d-b0b0-80b9b9edf7ff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:34.376581 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9b469dcc-4e3f-477d-b0b0-80b9b9edf7ff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:34.377462 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9b469dcc-4e3f-477d-b0b0-80b9b9edf7ff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:34.378078 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9b469dcc-4e3f-477d-b0b0-80b9b9edf7ff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:34.378889 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9b469dcc-4e3f-477d-b0b0-80b9b9edf7ff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:34.381705 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-619e8ba5-43d6-4b4c-86b3-51b2bb4c3c9b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Getting quotas for user 4ad2b6e8ec52485488f27ea84f2c69cc and project 728460a287914347b74cfe886f56ee6c. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:05:34.401792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-9b469dcc-4e3f-477d-b0b0-80b9b9edf7ff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] HTTP exception thrown: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9b469dcc-4e3f-477d-b0b0-80b9b9edf7ff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Request method failure captured: Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae HTTP/1.1 Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbxrzANyu0HiE-RI6YrwV4d8fV10ylWEIATegCXV8WUB95m5oAKUEypeFaRSmFIPzbJ8OQMl6Aud1_-7wjU4ZO6GDRxJPylRi9sW9fsJGE2eeMrNRP5hVeqDi3IdZCENn82q0KEmt_9wVferpVh22qvGQNXZFPNp1vMViuNoGirJUN4 Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:05:34.403938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:05:34.405214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_482490c45ac64607bba9ad021f2effbf"}]}] Sep 23 14:05:34.405214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:05:34.405214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:05:34.405214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:05:34.405214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:05:34.405214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:05:34.405214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:05:34.405214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 0db30f990aae49fabf9b8b19cd019de9 Sep 23 14:05:34.405214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:05:34.405214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:05:34.405214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:05:34.405214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '760e9fcc-3723-43bd-ab9b-db54f81db1ae'} Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:05:34.405912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:05:34.407711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:05:34.410714 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9b469dcc-4e3f-477d-b0b0-80b9b9edf7ff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Returning 404 to user: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:05:34.411936 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9b469dcc-4e3f-477d-b0b0-80b9b9edf7ff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 404 len: 111 microversion: 2.1 time: 0.067798 Sep 23 14:05:34.419590 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 181/348] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:34 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:05:34.422624 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e23f75c6-310d-4d18-9530-92d9071e40a0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '.version_select at 0x7f90893f68b0>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:34.500091 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-619e8ba5-43d6-4b4c-86b3-51b2bb4c3c9b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.424883 Sep 23 14:05:34.501860 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 168/349] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 23 14:05:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:05:34.511776 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f1c15600-38f1-4c5a-b9c0-cef94a2592e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:34.527787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f1c15600-38f1-4c5a-b9c0-cef94a2592e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:34.536024 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e23f75c6-310d-4d18-9530-92d9071e40a0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-48573208" status: 202 len: 0 microversion: 2.1 time: 0.118420 Sep 23 14:05:34.540353 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 182/350] 10.222.0.62 () {58 vars in 1215 bytes} [Fri Sep 23 14:05:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-48573208 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:05:34.550451 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f1c15600-38f1-4c5a-b9c0-cef94a2592e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:34.550957 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f1c15600-38f1-4c5a-b9c0-cef94a2592e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:34.551394 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f1c15600-38f1-4c5a-b9c0-cef94a2592e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:34.556244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f1c15600-38f1-4c5a-b9c0-cef94a2592e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:34.558440 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f1c15600-38f1-4c5a-b9c0-cef94a2592e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:34.563289 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f1c15600-38f1-4c5a-b9c0-cef94a2592e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:34.813093 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f1c15600-38f1-4c5a-b9c0-cef94a2592e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:34.825183 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f1c15600-38f1-4c5a-b9c0-cef94a2592e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:34.826705 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f1c15600-38f1-4c5a-b9c0-cef94a2592e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:34.827878 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f1c15600-38f1-4c5a-b9c0-cef94a2592e1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1741 microversion: 2.20 time: 0.324944 Sep 23 14:05:34.828454 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 169/351] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:34 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1741 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:35.842922 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b2b180e7-0253-488f-94d7-39b01ee10e66 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:35.844251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b2b180e7-0253-488f-94d7-39b01ee10e66 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:35.856271 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e34e3ebe-bd78-43ac-8786-89d182aec519 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:35.856883 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e34e3ebe-bd78-43ac-8786-89d182aec519 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:35.863419 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e34e3ebe-bd78-43ac-8786-89d182aec519 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:35.867875 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e34e3ebe-bd78-43ac-8786-89d182aec519 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:35.868840 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b2b180e7-0253-488f-94d7-39b01ee10e66 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:35.869348 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b2b180e7-0253-488f-94d7-39b01ee10e66 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:35.869797 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b2b180e7-0253-488f-94d7-39b01ee10e66 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:35.870556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b2b180e7-0253-488f-94d7-39b01ee10e66 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:35.871021 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b2b180e7-0253-488f-94d7-39b01ee10e66 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:35.871272 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e34e3ebe-bd78-43ac-8786-89d182aec519 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:35.872629 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e34e3ebe-bd78-43ac-8786-89d182aec519 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:35.874207 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e34e3ebe-bd78-43ac-8786-89d182aec519 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:35.874476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b2b180e7-0253-488f-94d7-39b01ee10e66 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:35.876311 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e34e3ebe-bd78-43ac-8786-89d182aec519 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:36.062831 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e34e3ebe-bd78-43ac-8786-89d182aec519 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:36.074686 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e34e3ebe-bd78-43ac-8786-89d182aec519 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:36.076687 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e34e3ebe-bd78-43ac-8786-89d182aec519 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:36.078101 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e34e3ebe-bd78-43ac-8786-89d182aec519 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1741 microversion: 2.20 time: 0.226953 Sep 23 14:05:36.090868 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 170/352] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:35 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:05:36.145957 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-b2b180e7-0253-488f-94d7-39b01ee10e66 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lazy-loading 'services' on Instance uuid 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:05:36.374651 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-6a25d800-5a5f-4b42-b959-85316acc5c1f req-820fb760-c7a7-4eb8-ae59-0f8f9c30bdff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97557fbe-c1f4-464e-93b8-3c71fbc48936", "name": "network-vif-plugged", "status": "completed", "tag": "0765d95c-b5b8-4eb9-aef1-96129a9a206d"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:05:36.390160 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-6a25d800-5a5f-4b42-b959-85316acc5c1f req-820fb760-c7a7-4eb8-ae59-0f8f9c30bdff service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:36.390674 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-6a25d800-5a5f-4b42-b959-85316acc5c1f req-820fb760-c7a7-4eb8-ae59-0f8f9c30bdff service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:36.391105 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-6a25d800-5a5f-4b42-b959-85316acc5c1f req-820fb760-c7a7-4eb8-ae59-0f8f9c30bdff service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:36.395074 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=100 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:36.408023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-6a25d800-5a5f-4b42-b959-85316acc5c1f req-820fb760-c7a7-4eb8-ae59-0f8f9c30bdff service nova] Creating event network-vif-plugged:0765d95c-b5b8-4eb9-aef1-96129a9a206d for instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 on hv-cinder-85743 Sep 23 14:05:36.411814 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-6a25d800-5a5f-4b42-b959-85316acc5c1f req-820fb760-c7a7-4eb8-ae59-0f8f9c30bdff service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042201 Sep 23 14:05:36.412410 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 171/353] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:05:36.530852 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b2b180e7-0253-488f-94d7-39b01ee10e66 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments/c0c380be-bbfd-4dd0-abe0-e09ff5c7f090" status: 202 len: 0 microversion: 2.1 time: 0.703607 Sep 23 14:05:36.535070 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 183/354] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 23 14:05:35 2022] DELETE /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments/c0c380be-bbfd-4dd0-abe0-e09ff5c7f090 => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:05:36.544872 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-378d8151-faca-4ead-9086-a2a66d160b24 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:36.547443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-378d8151-faca-4ead-9086-a2a66d160b24 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:36.565124 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-378d8151-faca-4ead-9086-a2a66d160b24 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:36.565624 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-378d8151-faca-4ead-9086-a2a66d160b24 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:36.566063 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-378d8151-faca-4ead-9086-a2a66d160b24 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:36.566896 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-378d8151-faca-4ead-9086-a2a66d160b24 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:36.567228 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-378d8151-faca-4ead-9086-a2a66d160b24 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:36.567651 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-378d8151-faca-4ead-9086-a2a66d160b24 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:36.657001 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-378d8151-faca-4ead-9086-a2a66d160b24 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120570 Sep 23 14:05:36.658909 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 172/355] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:05:36 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:05:37.107942 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-08302c6e-c197-49c2-8b03-7d6067c1ce61 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:37.108561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-08302c6e-c197-49c2-8b03-7d6067c1ce61 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:37.119550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-08302c6e-c197-49c2-8b03-7d6067c1ce61 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:37.120307 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-08302c6e-c197-49c2-8b03-7d6067c1ce61 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:37.121037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-08302c6e-c197-49c2-8b03-7d6067c1ce61 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:37.121950 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-08302c6e-c197-49c2-8b03-7d6067c1ce61 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:37.122595 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-08302c6e-c197-49c2-8b03-7d6067c1ce61 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:37.123177 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-08302c6e-c197-49c2-8b03-7d6067c1ce61 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:37.308313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-08302c6e-c197-49c2-8b03-7d6067c1ce61 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:37.321496 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-08302c6e-c197-49c2-8b03-7d6067c1ce61 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:37.323764 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-08302c6e-c197-49c2-8b03-7d6067c1ce61 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:37.325594 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-08302c6e-c197-49c2-8b03-7d6067c1ce61 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1741 microversion: 2.20 time: 0.223088 Sep 23 14:05:37.326969 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 184/356] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:37 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:37.672313 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-181ab618-701d-44eb-a33a-a389ec98541f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:37.676203 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-181ab618-701d-44eb-a33a-a389ec98541f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:37.689428 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-181ab618-701d-44eb-a33a-a389ec98541f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:37.690596 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-181ab618-701d-44eb-a33a-a389ec98541f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:37.691116 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-181ab618-701d-44eb-a33a-a389ec98541f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:37.691913 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-181ab618-701d-44eb-a33a-a389ec98541f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:37.692373 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-181ab618-701d-44eb-a33a-a389ec98541f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:37.702521 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-181ab618-701d-44eb-a33a-a389ec98541f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:37.748056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-181ab618-701d-44eb-a33a-a389ec98541f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081638 Sep 23 14:05:37.749269 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 173/357] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:05:37 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:05:38.354935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a89c116b-ac37-4d98-99db-db54e41b9097 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:38.355622 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a89c116b-ac37-4d98-99db-db54e41b9097 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:38.365236 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a89c116b-ac37-4d98-99db-db54e41b9097 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:38.365826 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a89c116b-ac37-4d98-99db-db54e41b9097 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:38.366358 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a89c116b-ac37-4d98-99db-db54e41b9097 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:38.368245 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a89c116b-ac37-4d98-99db-db54e41b9097 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:38.368876 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a89c116b-ac37-4d98-99db-db54e41b9097 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:38.369461 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a89c116b-ac37-4d98-99db-db54e41b9097 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:38.557991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a89c116b-ac37-4d98-99db-db54e41b9097 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:38.567790 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a89c116b-ac37-4d98-99db-db54e41b9097 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:38.569237 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a89c116b-ac37-4d98-99db-db54e41b9097 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:38.570999 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a89c116b-ac37-4d98-99db-db54e41b9097 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1741 microversion: 2.20 time: 0.222640 Sep 23 14:05:38.571597 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 185/358] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:38 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1741 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:05:38.763930 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1f4978f8-ce1b-45e0-8072-2502e04035d2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:38.771398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1f4978f8-ce1b-45e0-8072-2502e04035d2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:38.780714 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1f4978f8-ce1b-45e0-8072-2502e04035d2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:38.781180 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1f4978f8-ce1b-45e0-8072-2502e04035d2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:38.781732 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1f4978f8-ce1b-45e0-8072-2502e04035d2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:38.782545 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1f4978f8-ce1b-45e0-8072-2502e04035d2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:38.783035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1f4978f8-ce1b-45e0-8072-2502e04035d2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:38.783465 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1f4978f8-ce1b-45e0-8072-2502e04035d2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:38.822164 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1f4978f8-ce1b-45e0-8072-2502e04035d2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062312 Sep 23 14:05:38.822819 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 174/359] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:05:38 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:05:39.597294 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-86e9c8bb-ea35-43fb-b2ed-693a87e759b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:39.600530 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-86e9c8bb-ea35-43fb-b2ed-693a87e759b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:39.607197 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-86e9c8bb-ea35-43fb-b2ed-693a87e759b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:39.607739 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-86e9c8bb-ea35-43fb-b2ed-693a87e759b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:39.608178 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-86e9c8bb-ea35-43fb-b2ed-693a87e759b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:39.608866 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-86e9c8bb-ea35-43fb-b2ed-693a87e759b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:39.609340 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-86e9c8bb-ea35-43fb-b2ed-693a87e759b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:39.609793 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-86e9c8bb-ea35-43fb-b2ed-693a87e759b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:39.834255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-077a9e59-054c-40cf-98ce-2aef9dc3f54c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:39.840078 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-077a9e59-054c-40cf-98ce-2aef9dc3f54c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:39.860615 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-077a9e59-054c-40cf-98ce-2aef9dc3f54c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:39.861294 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-86e9c8bb-ea35-43fb-b2ed-693a87e759b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:39.862126 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-077a9e59-054c-40cf-98ce-2aef9dc3f54c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:39.870182 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-077a9e59-054c-40cf-98ce-2aef9dc3f54c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:39.871351 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-077a9e59-054c-40cf-98ce-2aef9dc3f54c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:39.872677 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-077a9e59-054c-40cf-98ce-2aef9dc3f54c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:39.874106 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-077a9e59-054c-40cf-98ce-2aef9dc3f54c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:39.877514 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-86e9c8bb-ea35-43fb-b2ed-693a87e759b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:39.881378 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-86e9c8bb-ea35-43fb-b2ed-693a87e759b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:39.883022 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-86e9c8bb-ea35-43fb-b2ed-693a87e759b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1741 microversion: 2.20 time: 0.289585 Sep 23 14:05:39.884189 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 186/360] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:39 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:40.128614 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-077a9e59-054c-40cf-98ce-2aef9dc3f54c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.298228 Sep 23 14:05:40.130370 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 175/361] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:05:39 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments => generated 197 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:05:40.910309 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f3e77db3-8d04-4bc9-854f-60cd52a68737 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:40.911047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f3e77db3-8d04-4bc9-854f-60cd52a68737 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:40.918371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f3e77db3-8d04-4bc9-854f-60cd52a68737 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:40.918902 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f3e77db3-8d04-4bc9-854f-60cd52a68737 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:40.919564 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f3e77db3-8d04-4bc9-854f-60cd52a68737 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:40.920528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f3e77db3-8d04-4bc9-854f-60cd52a68737 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:40.920988 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f3e77db3-8d04-4bc9-854f-60cd52a68737 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:40.921794 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f3e77db3-8d04-4bc9-854f-60cd52a68737 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:41.088240 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f3e77db3-8d04-4bc9-854f-60cd52a68737 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:41.102237 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f3e77db3-8d04-4bc9-854f-60cd52a68737 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:41.104631 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f3e77db3-8d04-4bc9-854f-60cd52a68737 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:41.106119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f3e77db3-8d04-4bc9-854f-60cd52a68737 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1741 microversion: 2.20 time: 0.199762 Sep 23 14:05:41.107053 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 187/362] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:40 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:41.141360 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9cbe4f90-9594-48f7-8e6b-c2889a0d00c9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:41.143509 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-9cbe4f90-9594-48f7-8e6b-c2889a0d00c9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:41.150614 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9cbe4f90-9594-48f7-8e6b-c2889a0d00c9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:41.157565 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9cbe4f90-9594-48f7-8e6b-c2889a0d00c9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:41.157565 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9cbe4f90-9594-48f7-8e6b-c2889a0d00c9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:41.157565 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9cbe4f90-9594-48f7-8e6b-c2889a0d00c9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:41.157565 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9cbe4f90-9594-48f7-8e6b-c2889a0d00c9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:41.158069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9cbe4f90-9594-48f7-8e6b-c2889a0d00c9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:41.204195 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-9cbe4f90-9594-48f7-8e6b-c2889a0d00c9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066952 Sep 23 14:05:41.204968 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 176/363] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:05:41 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:05:42.132460 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-48c901b8-a320-4e0c-a35e-b21e7ba889b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:42.133067 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-48c901b8-a320-4e0c-a35e-b21e7ba889b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:42.140875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-48c901b8-a320-4e0c-a35e-b21e7ba889b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:42.141358 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-48c901b8-a320-4e0c-a35e-b21e7ba889b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:42.141990 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-48c901b8-a320-4e0c-a35e-b21e7ba889b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:42.150248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-48c901b8-a320-4e0c-a35e-b21e7ba889b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:42.150740 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-48c901b8-a320-4e0c-a35e-b21e7ba889b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:42.151170 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-48c901b8-a320-4e0c-a35e-b21e7ba889b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:42.217907 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-dc33c84f-12de-4461-ae3d-1cb7d32d686a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:42.220397 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-dc33c84f-12de-4461-ae3d-1cb7d32d686a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:42.226874 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dc33c84f-12de-4461-ae3d-1cb7d32d686a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:42.227678 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dc33c84f-12de-4461-ae3d-1cb7d32d686a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:42.228353 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dc33c84f-12de-4461-ae3d-1cb7d32d686a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:42.229369 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dc33c84f-12de-4461-ae3d-1cb7d32d686a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:42.229830 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dc33c84f-12de-4461-ae3d-1cb7d32d686a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:42.230520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dc33c84f-12de-4461-ae3d-1cb7d32d686a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:42.271284 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-dc33c84f-12de-4461-ae3d-1cb7d32d686a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058388 Sep 23 14:05:42.271942 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 177/364] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:05:42 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:05:42.320781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-48c901b8-a320-4e0c-a35e-b21e7ba889b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:42.329571 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-48c901b8-a320-4e0c-a35e-b21e7ba889b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:42.331038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-48c901b8-a320-4e0c-a35e-b21e7ba889b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:42.332185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-48c901b8-a320-4e0c-a35e-b21e7ba889b6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1741 microversion: 2.20 time: 0.204453 Sep 23 14:05:42.332750 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 188/365] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:42 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:43.288984 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-25f66d25-3f35-42a9-b56f-0ea6acb8916e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:43.298243 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-25f66d25-3f35-42a9-b56f-0ea6acb8916e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:43.315942 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25f66d25-3f35-42a9-b56f-0ea6acb8916e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:43.316724 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25f66d25-3f35-42a9-b56f-0ea6acb8916e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:43.317354 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25f66d25-3f35-42a9-b56f-0ea6acb8916e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:43.318305 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25f66d25-3f35-42a9-b56f-0ea6acb8916e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:43.319006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25f66d25-3f35-42a9-b56f-0ea6acb8916e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:43.319663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25f66d25-3f35-42a9-b56f-0ea6acb8916e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:43.363415 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1df41e00-3b2e-4748-83b1-bdd826a39c7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:43.365641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1df41e00-3b2e-4748-83b1-bdd826a39c7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:43.375956 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1df41e00-3b2e-4748-83b1-bdd826a39c7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:43.379551 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1df41e00-3b2e-4748-83b1-bdd826a39c7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:43.391639 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1df41e00-3b2e-4748-83b1-bdd826a39c7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:43.393478 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1df41e00-3b2e-4748-83b1-bdd826a39c7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:43.394118 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1df41e00-3b2e-4748-83b1-bdd826a39c7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:43.394590 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1df41e00-3b2e-4748-83b1-bdd826a39c7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:43.412566 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-25f66d25-3f35-42a9-b56f-0ea6acb8916e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131401 Sep 23 14:05:43.413391 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 178/366] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:05:43 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:05:43.480822 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b6026677-d91a-457f-8d11-ba8a7efe4b20 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:05:43.486167 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b6026677-d91a-457f-8d11-ba8a7efe4b20 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:43.494231 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b6026677-d91a-457f-8d11-ba8a7efe4b20 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:43.495790 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b6026677-d91a-457f-8d11-ba8a7efe4b20 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:43.497972 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b6026677-d91a-457f-8d11-ba8a7efe4b20 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:43.499921 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b6026677-d91a-457f-8d11-ba8a7efe4b20 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:43.500559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b6026677-d91a-457f-8d11-ba8a7efe4b20 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:43.501363 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b6026677-d91a-457f-8d11-ba8a7efe4b20 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:43.539100 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-b6026677-d91a-457f-8d11-ba8a7efe4b20 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lazy-loading 'flavor' on Instance uuid 6891295c-5fe6-44a7-adf2-f1fb03036261 {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:05:43.596258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1df41e00-3b2e-4748-83b1-bdd826a39c7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:43.609690 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1df41e00-3b2e-4748-83b1-bdd826a39c7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:43.617561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1df41e00-3b2e-4748-83b1-bdd826a39c7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:43.628276 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1df41e00-3b2e-4748-83b1-bdd826a39c7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1741 microversion: 2.20 time: 0.268264 Sep 23 14:05:43.629133 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 189/367] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:43 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1741 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:44.074136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b6026677-d91a-457f-8d11-ba8a7efe4b20 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "POST /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/action" status: 200 len: 32 microversion: 2.1 time: 0.599181 Sep 23 14:05:44.075487 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 179/368] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 23 14:05:43 2022] POST /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/action => generated 32 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 14:05:44.085849 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ad8c3e33-7073-4269-a711-2b2cdb68c9f9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:44.086722 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ad8c3e33-7073-4269-a711-2b2cdb68c9f9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:44.093472 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad8c3e33-7073-4269-a711-2b2cdb68c9f9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:44.094013 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad8c3e33-7073-4269-a711-2b2cdb68c9f9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:44.094625 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad8c3e33-7073-4269-a711-2b2cdb68c9f9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:44.095336 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad8c3e33-7073-4269-a711-2b2cdb68c9f9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:44.095793 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad8c3e33-7073-4269-a711-2b2cdb68c9f9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:44.096219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad8c3e33-7073-4269-a711-2b2cdb68c9f9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:44.271462 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ad8c3e33-7073-4269-a711-2b2cdb68c9f9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:44.280783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ad8c3e33-7073-4269-a711-2b2cdb68c9f9 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1736 microversion: 2.1 time: 0.199875 Sep 23 14:05:44.284716 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 190/369] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:44 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:44.433211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-49f2b787-e07d-4f93-8415-125865a2ddba tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:44.437839 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-49f2b787-e07d-4f93-8415-125865a2ddba tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:44.447872 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=4 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:44.450601 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49f2b787-e07d-4f93-8415-125865a2ddba tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:44.451272 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49f2b787-e07d-4f93-8415-125865a2ddba tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:44.451709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49f2b787-e07d-4f93-8415-125865a2ddba tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:44.452409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49f2b787-e07d-4f93-8415-125865a2ddba tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:44.452874 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49f2b787-e07d-4f93-8415-125865a2ddba tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:44.453295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49f2b787-e07d-4f93-8415-125865a2ddba tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:44.508393 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-49f2b787-e07d-4f93-8415-125865a2ddba tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085731 Sep 23 14:05:44.509465 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 180/370] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:05:44 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 14:05:44.586729 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-be47779e-a099-4df6-85ac-bf3a23f1c007 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:44.587352 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-be47779e-a099-4df6-85ac-bf3a23f1c007 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:44.593901 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:44.595917 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-be47779e-a099-4df6-85ac-bf3a23f1c007 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:44.596468 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-be47779e-a099-4df6-85ac-bf3a23f1c007 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:44.596977 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-be47779e-a099-4df6-85ac-bf3a23f1c007 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:44.597747 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-be47779e-a099-4df6-85ac-bf3a23f1c007 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:44.598530 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-be47779e-a099-4df6-85ac-bf3a23f1c007 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:44.599048 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-be47779e-a099-4df6-85ac-bf3a23f1c007 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:44.659275 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fd3d181d-83dd-48bf-bbd6-422d774cfa5e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:44.660302 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-fd3d181d-83dd-48bf-bbd6-422d774cfa5e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:44.668406 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-be47779e-a099-4df6-85ac-bf3a23f1c007 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Going to try to terminate instance {{(pid=121073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:05:44.673621 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd3d181d-83dd-48bf-bbd6-422d774cfa5e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:44.678305 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd3d181d-83dd-48bf-bbd6-422d774cfa5e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:44.679079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd3d181d-83dd-48bf-bbd6-422d774cfa5e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:44.681015 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd3d181d-83dd-48bf-bbd6-422d774cfa5e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:44.682272 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd3d181d-83dd-48bf-bbd6-422d774cfa5e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:44.683410 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd3d181d-83dd-48bf-bbd6-422d774cfa5e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:45.001324 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fd3d181d-83dd-48bf-bbd6-422d774cfa5e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:45.019389 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fd3d181d-83dd-48bf-bbd6-422d774cfa5e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:45.019916 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fd3d181d-83dd-48bf-bbd6-422d774cfa5e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:45.021106 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fd3d181d-83dd-48bf-bbd6-422d774cfa5e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1741 microversion: 2.20 time: 0.366533 Sep 23 14:05:45.021990 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 181/371] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:44 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1741 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:45.067235 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-be47779e-a099-4df6-85ac-bf3a23f1c007 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 204 len: 0 microversion: 2.1 time: 0.483873 Sep 23 14:05:45.068090 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 191/372] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:05:44 2022] DELETE /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:05:45.078783 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1524736f-c7eb-41d8-992b-627b93db9dd8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:45.079393 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1524736f-c7eb-41d8-992b-627b93db9dd8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:45.087047 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:45.088174 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1524736f-c7eb-41d8-992b-627b93db9dd8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:45.088702 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1524736f-c7eb-41d8-992b-627b93db9dd8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:45.089163 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1524736f-c7eb-41d8-992b-627b93db9dd8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:45.089868 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1524736f-c7eb-41d8-992b-627b93db9dd8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:45.090319 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1524736f-c7eb-41d8-992b-627b93db9dd8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:45.090847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1524736f-c7eb-41d8-992b-627b93db9dd8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:45.263878 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-1524736f-c7eb-41d8-992b-627b93db9dd8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:45.271004 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1524736f-c7eb-41d8-992b-627b93db9dd8 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1682 microversion: 2.1 time: 0.198509 Sep 23 14:05:45.271583 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 182/373] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:45 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1682 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:45.312203 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f752a198-d4b8-4854-987c-9ab8d469ff38 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:45.313053 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f752a198-d4b8-4854-987c-9ab8d469ff38 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:45.319861 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f752a198-d4b8-4854-987c-9ab8d469ff38 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:45.320368 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f752a198-d4b8-4854-987c-9ab8d469ff38 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:45.320811 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f752a198-d4b8-4854-987c-9ab8d469ff38 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:45.321522 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f752a198-d4b8-4854-987c-9ab8d469ff38 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:45.322608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f752a198-d4b8-4854-987c-9ab8d469ff38 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:45.323054 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f752a198-d4b8-4854-987c-9ab8d469ff38 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:45.471058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f752a198-d4b8-4854-987c-9ab8d469ff38 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:45.480712 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f752a198-d4b8-4854-987c-9ab8d469ff38 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1736 microversion: 2.1 time: 0.172825 Sep 23 14:05:45.481417 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 192/374] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:45 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:46.047811 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-77b055b1-2481-4325-861a-92139f4e360d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:46.048419 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-77b055b1-2481-4325-861a-92139f4e360d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:46.054907 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-77b055b1-2481-4325-861a-92139f4e360d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:46.055392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-77b055b1-2481-4325-861a-92139f4e360d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:46.055828 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-77b055b1-2481-4325-861a-92139f4e360d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:46.056521 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-77b055b1-2481-4325-861a-92139f4e360d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:46.057266 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-77b055b1-2481-4325-861a-92139f4e360d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:46.057696 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-77b055b1-2481-4325-861a-92139f4e360d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:46.214025 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-77b055b1-2481-4325-861a-92139f4e360d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:46.223449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-77b055b1-2481-4325-861a-92139f4e360d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:46.227873 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-77b055b1-2481-4325-861a-92139f4e360d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:46.227873 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-77b055b1-2481-4325-861a-92139f4e360d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1741 microversion: 2.20 time: 0.182413 Sep 23 14:05:46.227873 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 183/375] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:46 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:46.296329 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f399b17d-e621-4327-8e09-5cf9afce91dc tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:46.297991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f399b17d-e621-4327-8e09-5cf9afce91dc tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:46.304726 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f399b17d-e621-4327-8e09-5cf9afce91dc tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:46.305285 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f399b17d-e621-4327-8e09-5cf9afce91dc tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:46.305737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f399b17d-e621-4327-8e09-5cf9afce91dc tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:46.306789 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f399b17d-e621-4327-8e09-5cf9afce91dc tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:46.307095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f399b17d-e621-4327-8e09-5cf9afce91dc tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:46.307624 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f399b17d-e621-4327-8e09-5cf9afce91dc tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:46.456104 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f399b17d-e621-4327-8e09-5cf9afce91dc tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:46.464750 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f399b17d-e621-4327-8e09-5cf9afce91dc tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1682 microversion: 2.1 time: 0.172312 Sep 23 14:05:46.465330 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 193/376] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:46 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:05:46.506930 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-34f9d860-40fb-4588-8943-347d4c2d15c6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:46.507529 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-34f9d860-40fb-4588-8943-347d4c2d15c6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:46.514515 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-34f9d860-40fb-4588-8943-347d4c2d15c6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:46.515009 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-34f9d860-40fb-4588-8943-347d4c2d15c6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:46.515454 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-34f9d860-40fb-4588-8943-347d4c2d15c6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:46.516155 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-34f9d860-40fb-4588-8943-347d4c2d15c6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:46.516652 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-34f9d860-40fb-4588-8943-347d4c2d15c6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:46.517084 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-34f9d860-40fb-4588-8943-347d4c2d15c6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:46.756962 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-34f9d860-40fb-4588-8943-347d4c2d15c6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:46.765952 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-34f9d860-40fb-4588-8943-347d4c2d15c6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1736 microversion: 2.1 time: 0.265308 Sep 23 14:05:46.766582 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 184/377] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:46 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1736 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:47.252993 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-94500e03-b808-4ef4-97b6-4a398997b506 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:47.254045 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-94500e03-b808-4ef4-97b6-4a398997b506 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:47.262321 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94500e03-b808-4ef4-97b6-4a398997b506 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:47.262833 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94500e03-b808-4ef4-97b6-4a398997b506 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:47.263270 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94500e03-b808-4ef4-97b6-4a398997b506 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:47.263993 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94500e03-b808-4ef4-97b6-4a398997b506 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:47.264444 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94500e03-b808-4ef4-97b6-4a398997b506 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:47.264864 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-94500e03-b808-4ef4-97b6-4a398997b506 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:47.490298 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ff253ce2-df18-4117-b906-a51debb76347 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:47.491530 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ff253ce2-df18-4117-b906-a51debb76347 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:47.499331 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff253ce2-df18-4117-b906-a51debb76347 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:47.500113 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff253ce2-df18-4117-b906-a51debb76347 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:47.500626 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff253ce2-df18-4117-b906-a51debb76347 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:47.501507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff253ce2-df18-4117-b906-a51debb76347 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:47.501972 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff253ce2-df18-4117-b906-a51debb76347 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:47.502421 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff253ce2-df18-4117-b906-a51debb76347 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:47.530273 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-94500e03-b808-4ef4-97b6-4a398997b506 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:47.538976 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-94500e03-b808-4ef4-97b6-4a398997b506 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:47.540425 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-94500e03-b808-4ef4-97b6-4a398997b506 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:47.542261 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-94500e03-b808-4ef4-97b6-4a398997b506 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1741 microversion: 2.20 time: 0.293091 Sep 23 14:05:47.542863 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 194/378] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:47 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:47.713657 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ff253ce2-df18-4117-b906-a51debb76347 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:47.721414 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ff253ce2-df18-4117-b906-a51debb76347 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1682 microversion: 2.1 time: 0.236291 Sep 23 14:05:47.721974 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 185/379] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:47 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:05:47.788847 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b483bb93-c38d-4f58-90bb-2c3e05e496fc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:47.789647 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b483bb93-c38d-4f58-90bb-2c3e05e496fc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:47.796806 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b483bb93-c38d-4f58-90bb-2c3e05e496fc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:47.797689 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b483bb93-c38d-4f58-90bb-2c3e05e496fc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:47.798555 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b483bb93-c38d-4f58-90bb-2c3e05e496fc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:47.799579 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b483bb93-c38d-4f58-90bb-2c3e05e496fc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:47.799973 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b483bb93-c38d-4f58-90bb-2c3e05e496fc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:47.800398 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b483bb93-c38d-4f58-90bb-2c3e05e496fc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:47.821059 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:48.025925 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b483bb93-c38d-4f58-90bb-2c3e05e496fc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:48.034380 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b483bb93-c38d-4f58-90bb-2c3e05e496fc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1736 microversion: 2.1 time: 0.249303 Sep 23 14:05:48.034957 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 195/380] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:47 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1736 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:48.204531 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-6e0dd22f-6af7-42fc-8c09-f91f585a2ec7 req-c495ff8b-654c-40eb-9bb1-a3753904b5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b6d10ec-d6f4-4d14-939c-beab0c9ba13b", "name": "network-vif-deleted", "tag": "8fa468b7-9788-436b-98a3-9a8ce2151269"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:05:48.232076 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-6e0dd22f-6af7-42fc-8c09-f91f585a2ec7 req-c495ff8b-654c-40eb-9bb1-a3753904b5d1 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:48.232817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-6e0dd22f-6af7-42fc-8c09-f91f585a2ec7 req-c495ff8b-654c-40eb-9bb1-a3753904b5d1 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:48.234211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-6e0dd22f-6af7-42fc-8c09-f91f585a2ec7 req-c495ff8b-654c-40eb-9bb1-a3753904b5d1 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:48.251029 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-6e0dd22f-6af7-42fc-8c09-f91f585a2ec7 req-c495ff8b-654c-40eb-9bb1-a3753904b5d1 service nova] Creating event network-vif-deleted:8fa468b7-9788-436b-98a3-9a8ce2151269 for instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b on hv-cinder-85743 Sep 23 14:05:48.257007 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-6e0dd22f-6af7-42fc-8c09-f91f585a2ec7 req-c495ff8b-654c-40eb-9bb1-a3753904b5d1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056180 Sep 23 14:05:48.258219 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 186/381] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:05:48.569603 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-970ab2cf-768e-466f-a9f4-53d0de1e317e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:48.570540 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-970ab2cf-768e-466f-a9f4-53d0de1e317e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:48.579458 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-970ab2cf-768e-466f-a9f4-53d0de1e317e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:48.580034 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-970ab2cf-768e-466f-a9f4-53d0de1e317e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:48.580567 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-970ab2cf-768e-466f-a9f4-53d0de1e317e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:48.581523 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-970ab2cf-768e-466f-a9f4-53d0de1e317e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:48.582183 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-970ab2cf-768e-466f-a9f4-53d0de1e317e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:48.582845 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-970ab2cf-768e-466f-a9f4-53d0de1e317e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:48.749108 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a8e88158-1287-4683-a8c9-00577a2c7122 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:48.749108 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a8e88158-1287-4683-a8c9-00577a2c7122 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:48.752863 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8e88158-1287-4683-a8c9-00577a2c7122 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:48.753564 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8e88158-1287-4683-a8c9-00577a2c7122 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:48.754153 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8e88158-1287-4683-a8c9-00577a2c7122 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:48.768298 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8e88158-1287-4683-a8c9-00577a2c7122 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:48.769049 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8e88158-1287-4683-a8c9-00577a2c7122 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:48.771176 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8e88158-1287-4683-a8c9-00577a2c7122 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:48.813712 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:48.829624 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8e88158-1287-4683-a8c9-00577a2c7122 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:48.830116 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8e88158-1287-4683-a8c9-00577a2c7122 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:48.830687 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8e88158-1287-4683-a8c9-00577a2c7122 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:48.831322 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-a8e88158-1287-4683-a8c9-00577a2c7122 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lazy-loading 'fault' on Instance uuid 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:05:48.890528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-970ab2cf-768e-466f-a9f4-53d0de1e317e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:48.900019 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-970ab2cf-768e-466f-a9f4-53d0de1e317e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:48.901769 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-970ab2cf-768e-466f-a9f4-53d0de1e317e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:48.903185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-970ab2cf-768e-466f-a9f4-53d0de1e317e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1723 microversion: 2.20 time: 0.338325 Sep 23 14:05:48.904785 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 196/382] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:48 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:48.918463 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a8e88158-1287-4683-a8c9-00577a2c7122 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:48.937439 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a8e88158-1287-4683-a8c9-00577a2c7122 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1331 microversion: 2.1 time: 0.196059 Sep 23 14:05:48.938008 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 187/383] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:48 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1331 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:05:49.058982 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f4049eb7-081f-4d4e-92cc-723fa0584f4c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:49.059536 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f4049eb7-081f-4d4e-92cc-723fa0584f4c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:49.065874 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4049eb7-081f-4d4e-92cc-723fa0584f4c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:49.066451 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4049eb7-081f-4d4e-92cc-723fa0584f4c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:49.067540 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4049eb7-081f-4d4e-92cc-723fa0584f4c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:49.067751 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4049eb7-081f-4d4e-92cc-723fa0584f4c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:49.068208 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4049eb7-081f-4d4e-92cc-723fa0584f4c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:49.068765 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4049eb7-081f-4d4e-92cc-723fa0584f4c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:49.210505 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f4049eb7-081f-4d4e-92cc-723fa0584f4c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:49.219520 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f4049eb7-081f-4d4e-92cc-723fa0584f4c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1736 microversion: 2.1 time: 0.164539 Sep 23 14:05:49.220081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 197/384] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:49 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:49.936534 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-2e2a417e-6787-4bf8-accb-b309cdce1b73 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:49.936534 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-2e2a417e-6787-4bf8-accb-b309cdce1b73 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:49.940918 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2e2a417e-6787-4bf8-accb-b309cdce1b73 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:49.941407 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2e2a417e-6787-4bf8-accb-b309cdce1b73 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:49.941844 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2e2a417e-6787-4bf8-accb-b309cdce1b73 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:49.942573 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2e2a417e-6787-4bf8-accb-b309cdce1b73 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:49.943034 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2e2a417e-6787-4bf8-accb-b309cdce1b73 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:49.943525 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2e2a417e-6787-4bf8-accb-b309cdce1b73 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:49.960645 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-968f244e-b8cc-4d5e-b47c-9186e4ebf6e9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:49.961250 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-968f244e-b8cc-4d5e-b47c-9186e4ebf6e9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:49.967697 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-968f244e-b8cc-4d5e-b47c-9186e4ebf6e9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:49.968175 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-968f244e-b8cc-4d5e-b47c-9186e4ebf6e9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:49.968613 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-968f244e-b8cc-4d5e-b47c-9186e4ebf6e9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:49.969298 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-968f244e-b8cc-4d5e-b47c-9186e4ebf6e9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:49.969748 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-968f244e-b8cc-4d5e-b47c-9186e4ebf6e9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:49.970165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-968f244e-b8cc-4d5e-b47c-9186e4ebf6e9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:50.004588 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-968f244e-b8cc-4d5e-b47c-9186e4ebf6e9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:50.005328 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-968f244e-b8cc-4d5e-b47c-9186e4ebf6e9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:50.005765 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-968f244e-b8cc-4d5e-b47c-9186e4ebf6e9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:50.006210 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-968f244e-b8cc-4d5e-b47c-9186e4ebf6e9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lazy-loading 'fault' on Instance uuid 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:05:50.066976 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-968f244e-b8cc-4d5e-b47c-9186e4ebf6e9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:50.075947 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-968f244e-b8cc-4d5e-b47c-9186e4ebf6e9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1331 microversion: 2.1 time: 0.119099 Sep 23 14:05:50.076521 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 198/385] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:49 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:05:50.102709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-2e2a417e-6787-4bf8-accb-b309cdce1b73 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:50.111266 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-2e2a417e-6787-4bf8-accb-b309cdce1b73 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:50.112691 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-2e2a417e-6787-4bf8-accb-b309cdce1b73 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:50.113830 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-2e2a417e-6787-4bf8-accb-b309cdce1b73 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1723 microversion: 2.20 time: 0.185154 Sep 23 14:05:50.114394 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 188/386] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:49 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:50.242573 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-2cb21436-dae8-4f15-9d4c-c0bfabfe18bf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:50.243185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-2cb21436-dae8-4f15-9d4c-c0bfabfe18bf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:50.249200 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2cb21436-dae8-4f15-9d4c-c0bfabfe18bf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:50.249677 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2cb21436-dae8-4f15-9d4c-c0bfabfe18bf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:50.250108 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2cb21436-dae8-4f15-9d4c-c0bfabfe18bf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:50.250817 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2cb21436-dae8-4f15-9d4c-c0bfabfe18bf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:50.251267 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2cb21436-dae8-4f15-9d4c-c0bfabfe18bf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:50.251688 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2cb21436-dae8-4f15-9d4c-c0bfabfe18bf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:50.381037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-2cb21436-dae8-4f15-9d4c-c0bfabfe18bf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:50.389426 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-2cb21436-dae8-4f15-9d4c-c0bfabfe18bf tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1736 microversion: 2.1 time: 0.150877 Sep 23 14:05:50.389996 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 199/387] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:50 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:51.098010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1faa2430-867f-4253-9a73-d467828d21e4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:51.098678 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1faa2430-867f-4253-9a73-d467828d21e4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:51.104712 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1faa2430-867f-4253-9a73-d467828d21e4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:51.105313 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1faa2430-867f-4253-9a73-d467828d21e4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:51.105746 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1faa2430-867f-4253-9a73-d467828d21e4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:51.106485 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1faa2430-867f-4253-9a73-d467828d21e4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:51.106941 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1faa2430-867f-4253-9a73-d467828d21e4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:51.107367 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1faa2430-867f-4253-9a73-d467828d21e4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:51.140056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1faa2430-867f-4253-9a73-d467828d21e4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:51.140644 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1faa2430-867f-4253-9a73-d467828d21e4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:51.141087 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1faa2430-867f-4253-9a73-d467828d21e4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:51.141423 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-13135d06-7635-408c-b610-05d36e957685 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:51.141869 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-1faa2430-867f-4253-9a73-d467828d21e4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lazy-loading 'fault' on Instance uuid 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:05:51.143079 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-13135d06-7635-408c-b610-05d36e957685 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:51.151559 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-13135d06-7635-408c-b610-05d36e957685 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:51.151837 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-13135d06-7635-408c-b610-05d36e957685 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:51.152354 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-13135d06-7635-408c-b610-05d36e957685 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:51.153201 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-13135d06-7635-408c-b610-05d36e957685 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:51.153717 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-13135d06-7635-408c-b610-05d36e957685 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:51.154170 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-13135d06-7635-408c-b610-05d36e957685 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:51.189059 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-1faa2430-867f-4253-9a73-d467828d21e4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:51.196780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1faa2430-867f-4253-9a73-d467828d21e4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 200 len: 1331 microversion: 2.1 time: 0.102462 Sep 23 14:05:51.198278 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 189/388] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:51 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:51.290386 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-13135d06-7635-408c-b610-05d36e957685 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:51.299389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-13135d06-7635-408c-b610-05d36e957685 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:51.301391 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-13135d06-7635-408c-b610-05d36e957685 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:51.301980 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-13135d06-7635-408c-b610-05d36e957685 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1723 microversion: 2.20 time: 0.165627 Sep 23 14:05:51.308316 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 200/389] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:51 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:51.420358 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0e9c2907-0c3a-4382-8917-3dc792a958be tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:51.420967 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-0e9c2907-0c3a-4382-8917-3dc792a958be tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:51.427309 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e9c2907-0c3a-4382-8917-3dc792a958be tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:51.427798 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e9c2907-0c3a-4382-8917-3dc792a958be tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:51.428239 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e9c2907-0c3a-4382-8917-3dc792a958be tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:51.428933 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e9c2907-0c3a-4382-8917-3dc792a958be tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:51.429390 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e9c2907-0c3a-4382-8917-3dc792a958be tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:51.429818 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0e9c2907-0c3a-4382-8917-3dc792a958be tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:51.561480 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-0e9c2907-0c3a-4382-8917-3dc792a958be tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:51.569803 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-0e9c2907-0c3a-4382-8917-3dc792a958be tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1736 microversion: 2.1 time: 0.154051 Sep 23 14:05:51.571998 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 190/390] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:51 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:52.037899 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-2bf0c6e1-74c8-43c8-9cfa-8c9fcea066f6 req-831f8fef-bd5e-46c5-9c0e-5d86645ca5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97557fbe-c1f4-464e-93b8-3c71fbc48936", "name": "network-vif-unplugged", "status": "completed", "tag": "0765d95c-b5b8-4eb9-aef1-96129a9a206d"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:05:52.048777 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2bf0c6e1-74c8-43c8-9cfa-8c9fcea066f6 req-831f8fef-bd5e-46c5-9c0e-5d86645ca5d0 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:52.049257 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2bf0c6e1-74c8-43c8-9cfa-8c9fcea066f6 req-831f8fef-bd5e-46c5-9c0e-5d86645ca5d0 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:52.049691 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2bf0c6e1-74c8-43c8-9cfa-8c9fcea066f6 req-831f8fef-bd5e-46c5-9c0e-5d86645ca5d0 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:52.062840 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-2bf0c6e1-74c8-43c8-9cfa-8c9fcea066f6 req-831f8fef-bd5e-46c5-9c0e-5d86645ca5d0 service nova] Creating event network-vif-unplugged:0765d95c-b5b8-4eb9-aef1-96129a9a206d for instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 on hv-cinder-85743 Sep 23 14:05:52.067983 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-2bf0c6e1-74c8-43c8-9cfa-8c9fcea066f6 req-831f8fef-bd5e-46c5-9c0e-5d86645ca5d0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034684 Sep 23 14:05:52.068567 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 201/391] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:05:52.219849 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4819782b-9a73-4df9-b281-f32ca6053ddd tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:52.220459 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4819782b-9a73-4df9-b281-f32ca6053ddd tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:52.226297 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4819782b-9a73-4df9-b281-f32ca6053ddd tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:52.226811 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4819782b-9a73-4df9-b281-f32ca6053ddd tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:52.227252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4819782b-9a73-4df9-b281-f32ca6053ddd tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:52.227932 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4819782b-9a73-4df9-b281-f32ca6053ddd tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:52.228382 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4819782b-9a73-4df9-b281-f32ca6053ddd tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:52.229309 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4819782b-9a73-4df9-b281-f32ca6053ddd tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:52.242920 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-4819782b-9a73-4df9-b281-f32ca6053ddd tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] HTTP exception thrown: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4819782b-9a73-4df9-b281-f32ca6053ddd tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Request method failure captured: Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b HTTP/1.1 Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxrzANyu0HiE-RI6YrwV4d8fV10ylWEIATegCXV8WUB95m5oAKUEypeFaRSmFIPzbJ8OQMl6Aud1_-7wjU4ZO6GDRxJPylRi9sW9fsJGE2eeMrNRP5hVeqDi3IdZCENn82q0KEmt_9wVferpVh22qvGQNXZFPNp1vMViuNoGirJUN4 Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:05:52.245317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:05:52.246899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_482490c45ac64607bba9ad021f2effbf"}]}] Sep 23 14:05:52.246899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:05:52.246899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:05:52.246899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:05:52.246899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:05:52.246899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:05:52.246899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:05:52.246899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 0db30f990aae49fabf9b8b19cd019de9 Sep 23 14:05:52.246899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:05:52.246899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:05:52.246899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:05:52.246899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': '3b6d10ec-d6f4-4d14-939c-beab0c9ba13b'} Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:05:52.247787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:05:52.249217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:05:52.250538 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4819782b-9a73-4df9-b281-f32ca6053ddd tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Returning 404 to user: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:05:52.250538 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4819782b-9a73-4df9-b281-f32ca6053ddd tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 404 len: 111 microversion: 2.1 time: 0.030848 Sep 23 14:05:52.250538 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 191/392] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:52 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:05:52.256562 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8acc51ab-35a3-480b-a0a0-6148290ab2c4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '.version_select at 0x7f9083c75ee0>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:52.327990 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b518987e-1c65-4d52-8691-8002d4cfe26a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:52.328608 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b518987e-1c65-4d52-8691-8002d4cfe26a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:52.334935 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b518987e-1c65-4d52-8691-8002d4cfe26a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:52.335419 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b518987e-1c65-4d52-8691-8002d4cfe26a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:52.335849 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b518987e-1c65-4d52-8691-8002d4cfe26a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:52.336527 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b518987e-1c65-4d52-8691-8002d4cfe26a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:52.337006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b518987e-1c65-4d52-8691-8002d4cfe26a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:52.337425 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b518987e-1c65-4d52-8691-8002d4cfe26a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:52.343104 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8acc51ab-35a3-480b-a0a0-6148290ab2c4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625848752" status: 202 len: 0 microversion: 2.1 time: 0.091078 Sep 23 14:05:52.343681 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 202/393] 10.222.0.62 () {58 vars in 1221 bytes} [Fri Sep 23 14:05:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625848752 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:05:52.534100 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b518987e-1c65-4d52-8691-8002d4cfe26a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:52.542869 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b518987e-1c65-4d52-8691-8002d4cfe26a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:52.544299 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b518987e-1c65-4d52-8691-8002d4cfe26a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:52.545437 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b518987e-1c65-4d52-8691-8002d4cfe26a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1666 microversion: 2.20 time: 0.221379 Sep 23 14:05:52.545972 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 192/394] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:52 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1666 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:05:52.574282 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3577f487-6662-46dd-9c30-348110e08ba6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcb463ed-1920-4c95-b596-e0ba4f14bfb1"}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:05:52.576745 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3577f487-6662-46dd-9c30-348110e08ba6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:52.583390 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3577f487-6662-46dd-9c30-348110e08ba6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:52.583874 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3577f487-6662-46dd-9c30-348110e08ba6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:52.584309 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3577f487-6662-46dd-9c30-348110e08ba6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:52.584995 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3577f487-6662-46dd-9c30-348110e08ba6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:52.585449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3577f487-6662-46dd-9c30-348110e08ba6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:52.585867 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3577f487-6662-46dd-9c30-348110e08ba6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:52.593376 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f08ea25e-938d-44f2-835c-8b929be99d1c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:52.594110 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f08ea25e-938d-44f2-835c-8b929be99d1c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:52.600013 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f08ea25e-938d-44f2-835c-8b929be99d1c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:52.601896 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f08ea25e-938d-44f2-835c-8b929be99d1c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:52.601896 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f08ea25e-938d-44f2-835c-8b929be99d1c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:52.601896 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f08ea25e-938d-44f2-835c-8b929be99d1c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:52.602167 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f08ea25e-938d-44f2-835c-8b929be99d1c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:52.602508 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f08ea25e-938d-44f2-835c-8b929be99d1c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:52.841310 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f08ea25e-938d-44f2-835c-8b929be99d1c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:52.849650 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f08ea25e-938d-44f2-835c-8b929be99d1c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1736 microversion: 2.1 time: 0.260007 Sep 23 14:05:52.850222 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 193/395] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:52 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1736 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:05:53.280393 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-bd7498ac-b696-43bd-a258-36beed637519 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Action: 'create', calling method: .version_select at 0x7f9083d1c280>, body: {"keypair": {"name": "tempest-keypair-2004025262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv6zpoNyIXgUwaP7tubJOEW3gr1c2sJ00f/UTOjjm0hdSmVL7p3HJLKambQWscOoWCv3uPe4LDsA4zxYG3GMhDmh4FsWHdmAF7vwmN4+iEBvMYJSCGZYfrqz82e4orqiw=="}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:05:53.296175 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-bd7498ac-b696-43bd-a258-36beed637519 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for project 482490c45ac64607bba9ad021f2effbf. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:05:53.300166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-bd7498ac-b696-43bd-a258-36beed637519 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for user 0db30f990aae49fabf9b8b19cd019de9 and project 482490c45ac64607bba9ad021f2effbf. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:05:53.397528 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-bd7498ac-b696-43bd-a258-36beed637519 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121554 Sep 23 14:05:53.398123 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 194/396] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 23 14:05:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:05:53.604728 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3577f487-6662-46dd-9c30-348110e08ba6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "POST /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.034158 Sep 23 14:05:53.605336 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 203/397] 10.222.0.62 () {62 vars in 1364 bytes} [Fri Sep 23 14:05:52 2022] POST /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/os-volume_attachments => generated 188 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 14:05:53.731837 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-14bb7984-f3f9-4473-a498-2c3da8241609 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:05:53.732465 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-14bb7984-f3f9-4473-a498-2c3da8241609 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:53.738558 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14bb7984-f3f9-4473-a498-2c3da8241609 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:53.739237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14bb7984-f3f9-4473-a498-2c3da8241609 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:53.740044 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14bb7984-f3f9-4473-a498-2c3da8241609 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:53.741045 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14bb7984-f3f9-4473-a498-2c3da8241609 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:53.741667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14bb7984-f3f9-4473-a498-2c3da8241609 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:53.742253 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14bb7984-f3f9-4473-a498-2c3da8241609 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:53.793216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-14bb7984-f3f9-4473-a498-2c3da8241609 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121074) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 14:05:53.872745 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-25ec6d61-0cb8-435e-8e93-af8c42560184 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:53.873356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-25ec6d61-0cb8-435e-8e93-af8c42560184 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:53.879454 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-25ec6d61-0cb8-435e-8e93-af8c42560184 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:53.879934 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-25ec6d61-0cb8-435e-8e93-af8c42560184 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:53.880370 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-25ec6d61-0cb8-435e-8e93-af8c42560184 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:53.881058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-25ec6d61-0cb8-435e-8e93-af8c42560184 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:53.881513 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-25ec6d61-0cb8-435e-8e93-af8c42560184 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:53.881931 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-25ec6d61-0cb8-435e-8e93-af8c42560184 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:54.032292 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-25ec6d61-0cb8-435e-8e93-af8c42560184 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:54.040618 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-25ec6d61-0cb8-435e-8e93-af8c42560184 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1736 microversion: 2.1 time: 0.171883 Sep 23 14:05:54.042864 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 204/398] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:53 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:05:54.069971 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-14bb7984-f3f9-4473-a498-2c3da8241609 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "POST /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/action" status: 202 len: 0 microversion: 2.20 time: 0.342114 Sep 23 14:05:54.070785 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 195/399] 10.222.0.62 () {62 vars in 1319 bytes} [Fri Sep 23 14:05:53 2022] POST /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:05:54.080426 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3e904b7c-3495-47b1-b77a-2c3b0fe063d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:54.081298 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3e904b7c-3495-47b1-b77a-2c3b0fe063d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:54.089021 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e904b7c-3495-47b1-b77a-2c3b0fe063d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:54.089549 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e904b7c-3495-47b1-b77a-2c3b0fe063d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:54.090058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e904b7c-3495-47b1-b77a-2c3b0fe063d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:54.090974 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e904b7c-3495-47b1-b77a-2c3b0fe063d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:54.091509 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e904b7c-3495-47b1-b77a-2c3b0fe063d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:54.092007 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e904b7c-3495-47b1-b77a-2c3b0fe063d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:54.246367 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3e904b7c-3495-47b1-b77a-2c3b0fe063d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:54.256121 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3e904b7c-3495-47b1-b77a-2c3b0fe063d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:54.257649 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3e904b7c-3495-47b1-b77a-2c3b0fe063d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:54.259032 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3e904b7c-3495-47b1-b77a-2c3b0fe063d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1752 microversion: 2.20 time: 0.182819 Sep 23 14:05:54.260039 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 205/400] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:54 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1752 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:55.063844 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-543f06e0-a244-4a23-b46d-da9c75147c66 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:55.064468 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-543f06e0-a244-4a23-b46d-da9c75147c66 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:55.070671 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-543f06e0-a244-4a23-b46d-da9c75147c66 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:55.071165 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-543f06e0-a244-4a23-b46d-da9c75147c66 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:55.071604 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-543f06e0-a244-4a23-b46d-da9c75147c66 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:55.072302 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-543f06e0-a244-4a23-b46d-da9c75147c66 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:55.073254 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-543f06e0-a244-4a23-b46d-da9c75147c66 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:55.074426 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-543f06e0-a244-4a23-b46d-da9c75147c66 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:55.200898 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1546902093", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1589397812", "security_groups": [{"name": "tempest-secgroup-smoke-470216429"}], "networks": [{"uuid": "190676c3-b885-43ca-a750-4bc929641327"}], "block_device_mapping_v2": [{"uuid": "9ae742da-c1cd-4c26-ae17-ab200f722d67", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:05:55.252347 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-543f06e0-a244-4a23-b46d-da9c75147c66 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:55.261374 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-543f06e0-a244-4a23-b46d-da9c75147c66 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1736 microversion: 2.1 time: 0.200620 Sep 23 14:05:55.262176 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 196/401] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:55 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:55.286136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8e456bf3-5d73-41d1-9737-a114c4dec980 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:55.286764 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8e456bf3-5d73-41d1-9737-a114c4dec980 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:55.292749 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e456bf3-5d73-41d1-9737-a114c4dec980 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:55.293236 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e456bf3-5d73-41d1-9737-a114c4dec980 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:55.293852 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e456bf3-5d73-41d1-9737-a114c4dec980 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:55.294581 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e456bf3-5d73-41d1-9737-a114c4dec980 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:55.295041 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e456bf3-5d73-41d1-9737-a114c4dec980 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:55.295464 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e456bf3-5d73-41d1-9737-a114c4dec980 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:55.407926 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.network.neutron [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] validate_networks() for [('190676c3-b885-43ca-a750-4bc929641327', None, None, None, None, None)] {{(pid=121073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:05:55.617572 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8e456bf3-5d73-41d1-9737-a114c4dec980 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:55.626979 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8e456bf3-5d73-41d1-9737-a114c4dec980 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:55.629004 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8e456bf3-5d73-41d1-9737-a114c4dec980 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:55.630249 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8e456bf3-5d73-41d1-9737-a114c4dec980 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1752 microversion: 2.20 time: 0.347961 Sep 23 14:05:55.631009 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 197/402] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:55 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1752 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:05:56.043172 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Flavor limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:05:56.043590 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Image limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:05:56.044092 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Flavor pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:05:56.044584 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Image pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:05:56.045008 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:05:56.053940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:56.054295 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:56.054755 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:56.055478 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:56.055929 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:56.056352 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:56.072819 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Getting quotas for project 728460a287914347b74cfe886f56ee6c. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:05:56.077498 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Getting quotas for user 4ad2b6e8ec52485488f27ea84f2c69cc and project 728460a287914347b74cfe886f56ee6c. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:05:56.140909 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Going to run 1 instances... {{(pid=121073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:05:56.143161 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ae742da-c1cd-4c26-ae17-ab200f722d67',volume_size=None,volume_type=None)] {{(pid=121073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:05:56.284964 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-917bb1ee-9f92-4bc4-b447-8c2f30c447b2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:56.285635 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-917bb1ee-9f92-4bc4-b447-8c2f30c447b2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:56.292088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-917bb1ee-9f92-4bc4-b447-8c2f30c447b2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:56.292568 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-917bb1ee-9f92-4bc4-b447-8c2f30c447b2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:56.293026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-917bb1ee-9f92-4bc4-b447-8c2f30c447b2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:56.293711 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-917bb1ee-9f92-4bc4-b447-8c2f30c447b2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:56.294160 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-917bb1ee-9f92-4bc4-b447-8c2f30c447b2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:56.294612 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-917bb1ee-9f92-4bc4-b447-8c2f30c447b2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:56.428814 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-917bb1ee-9f92-4bc4-b447-8c2f30c447b2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:56.437879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-917bb1ee-9f92-4bc4-b447-8c2f30c447b2 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1736 microversion: 2.1 time: 0.156724 Sep 23 14:05:56.438471 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 198/403] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:56 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:05:56.443492 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-609893276", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34e7a0c6-e35b-482b-a11c-b3c893e03a50"}], "security_groups": [{"name": "tempest-securitygroup--653613813"}], "key_name": "tempest-keypair-2004025262", "user_data": "}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:05:56.548564 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-182b8331-d909-479a-b95f-93d4506a27ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.351828 Sep 23 14:05:56.550105 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 206/404] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:05:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 14:05:56.552276 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.network.neutron [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] validate_networks() for [('34e7a0c6-e35b-482b-a11c-b3c893e03a50', None, None, None, None, None)] {{(pid=121074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:05:56.561005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-91e6280d-919c-4cc5-9ca8-00a6d04032cb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:56.561621 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-91e6280d-919c-4cc5-9ca8-00a6d04032cb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:56.649055 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-91e6280d-919c-4cc5-9ca8-00a6d04032cb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:56.657345 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-91e6280d-919c-4cc5-9ca8-00a6d04032cb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1089 microversion: 2.1 time: 0.100632 Sep 23 14:05:56.674123 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 207/405] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:56 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1089 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:05:56.678701 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b1a57efc-725a-4e54-b424-d6b1efcad1f8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:56.679426 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b1a57efc-725a-4e54-b424-d6b1efcad1f8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:56.686379 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b1a57efc-725a-4e54-b424-d6b1efcad1f8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:56.687490 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b1a57efc-725a-4e54-b424-d6b1efcad1f8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:56.687949 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b1a57efc-725a-4e54-b424-d6b1efcad1f8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:56.688704 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b1a57efc-725a-4e54-b424-d6b1efcad1f8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:56.689564 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b1a57efc-725a-4e54-b424-d6b1efcad1f8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:56.689678 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b1a57efc-725a-4e54-b424-d6b1efcad1f8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:56.927512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b1a57efc-725a-4e54-b424-d6b1efcad1f8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:56.940177 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b1a57efc-725a-4e54-b424-d6b1efcad1f8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:56.940312 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b1a57efc-725a-4e54-b424-d6b1efcad1f8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:56.941360 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b1a57efc-725a-4e54-b424-d6b1efcad1f8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1754 microversion: 2.20 time: 0.269552 Sep 23 14:05:56.942044 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 208/406] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:56 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1754 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:57.057020 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Flavor limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:05:57.057764 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Image limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:05:57.058222 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Flavor pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:05:57.058726 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Image pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:05:57.059136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:05:57.068154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:57.068641 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:57.069069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:57.069790 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:57.070242 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:57.070687 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:57.088159 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for project 482490c45ac64607bba9ad021f2effbf. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:05:57.092871 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for user 0db30f990aae49fabf9b8b19cd019de9 and project 482490c45ac64607bba9ad021f2effbf. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:05:57.104833 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Going to run 1 instances... {{(pid=121074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:05:57.108143 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:05:57.241150 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-210e80b5-c089-46bd-b5d2-c2d05e6c5cd1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.801490 Sep 23 14:05:57.241971 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 199/407] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:05:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 14:05:57.253574 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-017315f1-d19f-4a8c-ba0a-6d259dda9f6b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:57.254218 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-017315f1-d19f-4a8c-ba0a-6d259dda9f6b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:57.313023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-017315f1-d19f-4a8c-ba0a-6d259dda9f6b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:57.319807 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-017315f1-d19f-4a8c-ba0a-6d259dda9f6b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1241 microversion: 2.1 time: 0.070615 Sep 23 14:05:57.320362 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 209/408] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:57 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:57.461055 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a27cf0c6-94da-46ac-ab9a-b3e090da637c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:57.461671 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a27cf0c6-94da-46ac-ab9a-b3e090da637c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:57.472510 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a27cf0c6-94da-46ac-ab9a-b3e090da637c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:57.472850 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a27cf0c6-94da-46ac-ab9a-b3e090da637c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:57.473290 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a27cf0c6-94da-46ac-ab9a-b3e090da637c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:57.473996 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a27cf0c6-94da-46ac-ab9a-b3e090da637c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:57.474504 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a27cf0c6-94da-46ac-ab9a-b3e090da637c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:57.475121 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a27cf0c6-94da-46ac-ab9a-b3e090da637c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:57.611144 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a27cf0c6-94da-46ac-ab9a-b3e090da637c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:57.620544 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a27cf0c6-94da-46ac-ab9a-b3e090da637c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1736 microversion: 2.1 time: 0.163363 Sep 23 14:05:57.640319 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 200/409] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:57 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:57.684522 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-fbf9eca3-5dfd-4e8d-a978-33d497c9bfee tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:57.685315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-fbf9eca3-5dfd-4e8d-a978-33d497c9bfee tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:57.738250 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-fbf9eca3-5dfd-4e8d-a978-33d497c9bfee tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:57.745369 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-fbf9eca3-5dfd-4e8d-a978-33d497c9bfee tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1089 microversion: 2.1 time: 0.065351 Sep 23 14:05:57.745923 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 210/410] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:57 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:57.975504 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-35fa36c6-b57f-4c9c-910d-11d91505c298 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:57.976151 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-35fa36c6-b57f-4c9c-910d-11d91505c298 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:57.982146 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-35fa36c6-b57f-4c9c-910d-11d91505c298 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:57.982713 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-35fa36c6-b57f-4c9c-910d-11d91505c298 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:57.983165 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-35fa36c6-b57f-4c9c-910d-11d91505c298 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:57.983860 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-35fa36c6-b57f-4c9c-910d-11d91505c298 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:57.984312 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-35fa36c6-b57f-4c9c-910d-11d91505c298 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:57.984735 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-35fa36c6-b57f-4c9c-910d-11d91505c298 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:58.117065 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-35fa36c6-b57f-4c9c-910d-11d91505c298 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:58.126617 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-35fa36c6-b57f-4c9c-910d-11d91505c298 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:58.128086 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-35fa36c6-b57f-4c9c-910d-11d91505c298 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:58.129201 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-35fa36c6-b57f-4c9c-910d-11d91505c298 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.157629 Sep 23 14:05:58.129756 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 201/411] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:57 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:58.342145 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-58239c55-da6e-46cd-a6dd-c6100ce2261e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:58.342761 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-58239c55-da6e-46cd-a6dd-c6100ce2261e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:58.349169 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-58239c55-da6e-46cd-a6dd-c6100ce2261e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:58.349675 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-58239c55-da6e-46cd-a6dd-c6100ce2261e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:58.350095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-58239c55-da6e-46cd-a6dd-c6100ce2261e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:58.350817 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-58239c55-da6e-46cd-a6dd-c6100ce2261e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:58.351283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-58239c55-da6e-46cd-a6dd-c6100ce2261e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:58.351712 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-58239c55-da6e-46cd-a6dd-c6100ce2261e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:58.413721 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-58239c55-da6e-46cd-a6dd-c6100ce2261e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:58.421843 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-58239c55-da6e-46cd-a6dd-c6100ce2261e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1245 microversion: 2.1 time: 0.083854 Sep 23 14:05:58.422421 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 211/412] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:58 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:58.645147 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d09a2192-b839-4281-8f33-0ef736b57bff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:58.645672 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d09a2192-b839-4281-8f33-0ef736b57bff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:58.651666 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d09a2192-b839-4281-8f33-0ef736b57bff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:58.652156 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d09a2192-b839-4281-8f33-0ef736b57bff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:58.653092 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d09a2192-b839-4281-8f33-0ef736b57bff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:58.653871 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d09a2192-b839-4281-8f33-0ef736b57bff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:58.654317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d09a2192-b839-4281-8f33-0ef736b57bff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:58.654769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d09a2192-b839-4281-8f33-0ef736b57bff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:58.768292 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a3f38602-099b-41aa-b92d-cd0607d443ab tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:58.769355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a3f38602-099b-41aa-b92d-cd0607d443ab tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:58.775278 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a3f38602-099b-41aa-b92d-cd0607d443ab tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:58.775765 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a3f38602-099b-41aa-b92d-cd0607d443ab tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:58.777216 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a3f38602-099b-41aa-b92d-cd0607d443ab tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:58.780186 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a3f38602-099b-41aa-b92d-cd0607d443ab tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:58.780857 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a3f38602-099b-41aa-b92d-cd0607d443ab tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:58.781429 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a3f38602-099b-41aa-b92d-cd0607d443ab tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:58.802122 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d09a2192-b839-4281-8f33-0ef736b57bff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:58.811479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d09a2192-b839-4281-8f33-0ef736b57bff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1736 microversion: 2.1 time: 0.170106 Sep 23 14:05:58.812149 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 202/413] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:58 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:58.858058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a3f38602-099b-41aa-b92d-cd0607d443ab tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:58.866262 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a3f38602-099b-41aa-b92d-cd0607d443ab tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1139 microversion: 2.1 time: 0.101775 Sep 23 14:05:58.866954 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 212/414] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:58 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1139 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:05:59.154977 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-bc58f9a9-fd95-4b95-8e49-7a1904a905eb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:59.155523 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-bc58f9a9-fd95-4b95-8e49-7a1904a905eb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:59.161412 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bc58f9a9-fd95-4b95-8e49-7a1904a905eb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:59.161885 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bc58f9a9-fd95-4b95-8e49-7a1904a905eb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:59.162314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bc58f9a9-fd95-4b95-8e49-7a1904a905eb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:59.163009 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bc58f9a9-fd95-4b95-8e49-7a1904a905eb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:59.163456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bc58f9a9-fd95-4b95-8e49-7a1904a905eb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:59.163874 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bc58f9a9-fd95-4b95-8e49-7a1904a905eb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:59.294680 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-bc58f9a9-fd95-4b95-8e49-7a1904a905eb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:59.303407 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-bc58f9a9-fd95-4b95-8e49-7a1904a905eb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:59.304848 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-bc58f9a9-fd95-4b95-8e49-7a1904a905eb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:59.305998 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-bc58f9a9-fd95-4b95-8e49-7a1904a905eb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.155755 Sep 23 14:05:59.306568 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 203/415] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:05:59 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:05:59.445114 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f7f64c31-a8d3-4e68-8c2f-9ef32379c1ad tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:59.445640 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f7f64c31-a8d3-4e68-8c2f-9ef32379c1ad tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:59.452709 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7f64c31-a8d3-4e68-8c2f-9ef32379c1ad tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:59.453190 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7f64c31-a8d3-4e68-8c2f-9ef32379c1ad tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:59.453624 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7f64c31-a8d3-4e68-8c2f-9ef32379c1ad tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:59.454299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7f64c31-a8d3-4e68-8c2f-9ef32379c1ad tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:59.454779 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7f64c31-a8d3-4e68-8c2f-9ef32379c1ad tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:59.455202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7f64c31-a8d3-4e68-8c2f-9ef32379c1ad tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:59.514160 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f7f64c31-a8d3-4e68-8c2f-9ef32379c1ad tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:05:59.521687 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f7f64c31-a8d3-4e68-8c2f-9ef32379c1ad tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1237 microversion: 2.1 time: 0.080483 Sep 23 14:05:59.522253 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 213/416] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:59 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:05:59.835851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a8627c37-0679-46ec-90ac-4ba922c313dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:59.836478 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a8627c37-0679-46ec-90ac-4ba922c313dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:59.842508 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8627c37-0679-46ec-90ac-4ba922c313dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:59.842987 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8627c37-0679-46ec-90ac-4ba922c313dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:59.843427 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8627c37-0679-46ec-90ac-4ba922c313dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:59.844103 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8627c37-0679-46ec-90ac-4ba922c313dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:59.844571 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8627c37-0679-46ec-90ac-4ba922c313dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:59.845016 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a8627c37-0679-46ec-90ac-4ba922c313dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:59.862628 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:59.889438 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-eccd24e6-5371-49b8-b0ae-80dc9044cc8b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:05:59.890196 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-eccd24e6-5371-49b8-b0ae-80dc9044cc8b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:05:59.896476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-eccd24e6-5371-49b8-b0ae-80dc9044cc8b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:59.896966 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-eccd24e6-5371-49b8-b0ae-80dc9044cc8b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:59.897403 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-eccd24e6-5371-49b8-b0ae-80dc9044cc8b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:59.898131 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-eccd24e6-5371-49b8-b0ae-80dc9044cc8b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:05:59.898615 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-eccd24e6-5371-49b8-b0ae-80dc9044cc8b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:05:59.899229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-eccd24e6-5371-49b8-b0ae-80dc9044cc8b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:05:59.918013 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:00.010581 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-eccd24e6-5371-49b8-b0ae-80dc9044cc8b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:00.018062 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-eccd24e6-5371-49b8-b0ae-80dc9044cc8b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1131 microversion: 2.1 time: 0.133270 Sep 23 14:06:00.018647 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 214/417] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:59 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1131 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:00.085060 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a8627c37-0679-46ec-90ac-4ba922c313dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:00.093849 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a8627c37-0679-46ec-90ac-4ba922c313dd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1736 microversion: 2.1 time: 0.261852 Sep 23 14:06:00.094356 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 204/418] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:05:59 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1736 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:00.332058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-04f167e3-dabb-4dc6-85e9-ff1feb3e1702 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:00.332671 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-04f167e3-dabb-4dc6-85e9-ff1feb3e1702 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:00.339220 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-04f167e3-dabb-4dc6-85e9-ff1feb3e1702 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:00.339704 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-04f167e3-dabb-4dc6-85e9-ff1feb3e1702 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:00.340165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-04f167e3-dabb-4dc6-85e9-ff1feb3e1702 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:00.342186 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-04f167e3-dabb-4dc6-85e9-ff1feb3e1702 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:00.342186 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-04f167e3-dabb-4dc6-85e9-ff1feb3e1702 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:00.342614 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-04f167e3-dabb-4dc6-85e9-ff1feb3e1702 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:00.468968 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-04f167e3-dabb-4dc6-85e9-ff1feb3e1702 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:00.477655 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-04f167e3-dabb-4dc6-85e9-ff1feb3e1702 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:00.479132 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-04f167e3-dabb-4dc6-85e9-ff1feb3e1702 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:00.480282 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-04f167e3-dabb-4dc6-85e9-ff1feb3e1702 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.152154 Sep 23 14:06:00.480870 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 215/419] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:00 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:06:00.544531 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-154c67c5-426c-402e-85c6-fffe76f85525 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:00.545133 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-154c67c5-426c-402e-85c6-fffe76f85525 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:00.551250 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-154c67c5-426c-402e-85c6-fffe76f85525 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:00.551758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-154c67c5-426c-402e-85c6-fffe76f85525 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:00.552194 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-154c67c5-426c-402e-85c6-fffe76f85525 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:00.552872 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-154c67c5-426c-402e-85c6-fffe76f85525 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:00.553323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-154c67c5-426c-402e-85c6-fffe76f85525 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:00.553742 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-154c67c5-426c-402e-85c6-fffe76f85525 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:00.613403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-154c67c5-426c-402e-85c6-fffe76f85525 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:00.620935 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-154c67c5-426c-402e-85c6-fffe76f85525 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1293 microversion: 2.1 time: 0.080233 Sep 23 14:06:00.621486 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 205/420] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:00 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1293 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:01.043180 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3ad37a91-ec20-4fb0-b396-ffe5a950e1c5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:01.043829 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3ad37a91-ec20-4fb0-b396-ffe5a950e1c5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:01.050539 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3ad37a91-ec20-4fb0-b396-ffe5a950e1c5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:01.051049 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3ad37a91-ec20-4fb0-b396-ffe5a950e1c5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:01.051487 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3ad37a91-ec20-4fb0-b396-ffe5a950e1c5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:01.052175 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3ad37a91-ec20-4fb0-b396-ffe5a950e1c5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:01.052635 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3ad37a91-ec20-4fb0-b396-ffe5a950e1c5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:01.053059 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3ad37a91-ec20-4fb0-b396-ffe5a950e1c5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:01.114444 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3ad37a91-ec20-4fb0-b396-ffe5a950e1c5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:01.117148 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-c42b8e52-9213-44c2-84fa-6ea970c7573d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:01.121285 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-c42b8e52-9213-44c2-84fa-6ea970c7573d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:01.122027 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3ad37a91-ec20-4fb0-b396-ffe5a950e1c5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1131 microversion: 2.1 time: 0.082711 Sep 23 14:06:01.123147 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 216/421] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:01 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1131 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:01.124727 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c42b8e52-9213-44c2-84fa-6ea970c7573d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:01.125213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c42b8e52-9213-44c2-84fa-6ea970c7573d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:01.125644 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c42b8e52-9213-44c2-84fa-6ea970c7573d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:01.126443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c42b8e52-9213-44c2-84fa-6ea970c7573d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:01.126901 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c42b8e52-9213-44c2-84fa-6ea970c7573d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:01.127325 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c42b8e52-9213-44c2-84fa-6ea970c7573d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:01.332818 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-c42b8e52-9213-44c2-84fa-6ea970c7573d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:01.341722 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-c42b8e52-9213-44c2-84fa-6ea970c7573d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1716 microversion: 2.1 time: 0.228355 Sep 23 14:06:01.342649 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 206/422] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:01 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1716 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:01.462121 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-27183227-ea28-4042-98e5-f49e26a4990a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:01.462650 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-27183227-ea28-4042-98e5-f49e26a4990a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:01.470550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27183227-ea28-4042-98e5-f49e26a4990a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:01.471037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27183227-ea28-4042-98e5-f49e26a4990a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:01.471481 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27183227-ea28-4042-98e5-f49e26a4990a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:01.472246 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27183227-ea28-4042-98e5-f49e26a4990a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:01.472705 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27183227-ea28-4042-98e5-f49e26a4990a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:01.473134 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27183227-ea28-4042-98e5-f49e26a4990a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:01.505234 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4bb64ef1-7450-4acf-9a2c-4fd4409b0779 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:01.505761 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4bb64ef1-7450-4acf-9a2c-4fd4409b0779 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:01.511801 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4bb64ef1-7450-4acf-9a2c-4fd4409b0779 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:01.512292 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4bb64ef1-7450-4acf-9a2c-4fd4409b0779 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:01.512914 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4bb64ef1-7450-4acf-9a2c-4fd4409b0779 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:01.513849 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4bb64ef1-7450-4acf-9a2c-4fd4409b0779 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:01.514493 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4bb64ef1-7450-4acf-9a2c-4fd4409b0779 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:01.515087 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4bb64ef1-7450-4acf-9a2c-4fd4409b0779 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:01.578995 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-27183227-ea28-4042-98e5-f49e26a4990a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] HTTP exception thrown: Cannot 'detach_volume' instance 6891295c-5fe6-44a7-adf2-f1fb03036261 while it is in vm_state rescued Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-27183227-ea28-4042-98e5-f49e26a4990a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Request method failure captured: Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: DELETE /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-volume_attachments/d5cd9758-d1cd-44b9-a39b-2115a07e981a HTTP/1.1 Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbxnzDm6DgW0nTYDFDzi5SOHvSPJ6hZrF_pz9Ph0XCziqGU45FO9Ids8cW2I9WFrbXMdkl7DdqmLLFpEppSALkiMXJRcKEd-oKGJ1eeg29_bry9MG0PBEvVfdfr6Lqo4PU_2dBPb3P4fhNFCVeOEEyfkxVL-v3y86ZS4kPvYsqdra7o Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: d08a219027684089a91c354749c67d5d Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:06:01.580737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:06:01.582149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d08a219027684089a91c354749c67d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d08a219027684089a91c354749c67d5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d08a219027684089a91c354749c67d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d08a219027684089a91c354749c67d5d"}]}] Sep 23 14:06:01.582149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:06:01.582149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: d08a219027684089a91c354749c67d5d Sep 23 14:06:01.582149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:06:01.582149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-ServerRescueNegativeTestJSON-1299274290-project Sep 23 14:06:01.582149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:06:01.582149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:06:01.582149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 28b64a35d7b44519a1d93919f2e23083 Sep 23 14:06:01.582149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1299274290-project Sep 23 14:06:01.582149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:06:01.582149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Cannot 'detach_volume' instance 6891295c-5fe6-44a7-adf2-f1fb03036261 while it is in vm_state rescued Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'server_id': '6891295c-5fe6-44a7-adf2-f1fb03036261', 'id': 'd5cd9758-d1cd-44b9-a39b-2115a07e981a'} Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6891295c-5fe6-44a7-adf2-f1fb03036261 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:06:01.582935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6891295c-5fe6-44a7-adf2-f1fb03036261 while it is in vm_state rescued Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6891295c-5fe6-44a7-adf2-f1fb03036261 while it is in vm_state rescued Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:06:01.584149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-27183227-ea28-4042-98e5-f49e26a4990a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Returning 409 to user: Cannot 'detach_volume' instance 6891295c-5fe6-44a7-adf2-f1fb03036261 while it is in vm_state rescued {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:06:01.585059 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-27183227-ea28-4042-98e5-f49e26a4990a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-volume_attachments/d5cd9758-d1cd-44b9-a39b-2115a07e981a" status: 409 len: 152 microversion: 2.1 time: 0.125069 Sep 23 14:06:01.585059 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 217/423] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 23 14:06:01 2022] DELETE /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-volume_attachments/d5cd9758-d1cd-44b9-a39b-2115a07e981a => generated 152 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 14:06:01.594738 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b4114843-1b63-4d66-997f-d6633b1e4be4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:06:01.594738 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b4114843-1b63-4d66-997f-d6633b1e4be4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:01.598246 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b4114843-1b63-4d66-997f-d6633b1e4be4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:01.598772 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b4114843-1b63-4d66-997f-d6633b1e4be4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:01.599209 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b4114843-1b63-4d66-997f-d6633b1e4be4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:01.599898 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b4114843-1b63-4d66-997f-d6633b1e4be4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:01.600354 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b4114843-1b63-4d66-997f-d6633b1e4be4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:01.600781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b4114843-1b63-4d66-997f-d6633b1e4be4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:01.683910 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4bb64ef1-7450-4acf-9a2c-4fd4409b0779 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:01.694382 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4bb64ef1-7450-4acf-9a2c-4fd4409b0779 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:01.695944 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4bb64ef1-7450-4acf-9a2c-4fd4409b0779 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:01.697357 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4bb64ef1-7450-4acf-9a2c-4fd4409b0779 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.196101 Sep 23 14:06:01.698032 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 207/424] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:01 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:06:01.703466 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1ab96d42-4546-4ecd-a1ec-795d0937ab46 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:01.704077 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1ab96d42-4546-4ecd-a1ec-795d0937ab46 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:01.710725 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1ab96d42-4546-4ecd-a1ec-795d0937ab46 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:01.711494 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1ab96d42-4546-4ecd-a1ec-795d0937ab46 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:01.712071 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1ab96d42-4546-4ecd-a1ec-795d0937ab46 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:01.713312 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1ab96d42-4546-4ecd-a1ec-795d0937ab46 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:01.714103 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1ab96d42-4546-4ecd-a1ec-795d0937ab46 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:01.714709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1ab96d42-4546-4ecd-a1ec-795d0937ab46 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:01.830910 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b4114843-1b63-4d66-997f-d6633b1e4be4 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "POST /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/action" status: 202 len: 0 microversion: 2.1 time: 0.243498 Sep 23 14:06:01.839631 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 218/425] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 23 14:06:01 2022] POST /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:06:01.850698 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b52e7900-cf8c-4928-8600-1a05bb487529 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:01.851457 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b52e7900-cf8c-4928-8600-1a05bb487529 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:01.853244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-1ab96d42-4546-4ecd-a1ec-795d0937ab46 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:01.860360 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b52e7900-cf8c-4928-8600-1a05bb487529 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:01.860878 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b52e7900-cf8c-4928-8600-1a05bb487529 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:01.861438 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b52e7900-cf8c-4928-8600-1a05bb487529 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:01.862159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b52e7900-cf8c-4928-8600-1a05bb487529 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:01.862451 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1ab96d42-4546-4ecd-a1ec-795d0937ab46 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1311 microversion: 2.1 time: 0.163096 Sep 23 14:06:01.862649 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b52e7900-cf8c-4928-8600-1a05bb487529 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:01.863086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b52e7900-cf8c-4928-8600-1a05bb487529 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:01.876919 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 208/426] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:01 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1311 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:02.147544 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9afdea56-125a-4a1e-90fb-3ec41c24a0b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:02.149286 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-9afdea56-125a-4a1e-90fb-3ec41c24a0b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:02.167346 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9afdea56-125a-4a1e-90fb-3ec41c24a0b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:02.168421 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9afdea56-125a-4a1e-90fb-3ec41c24a0b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:02.172631 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9afdea56-125a-4a1e-90fb-3ec41c24a0b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:02.176533 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9afdea56-125a-4a1e-90fb-3ec41c24a0b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:02.178546 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9afdea56-125a-4a1e-90fb-3ec41c24a0b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:02.180424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9afdea56-125a-4a1e-90fb-3ec41c24a0b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:02.300621 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9afdea56-125a-4a1e-90fb-3ec41c24a0b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:02.313787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-9afdea56-125a-4a1e-90fb-3ec41c24a0b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1187 microversion: 2.1 time: 0.170517 Sep 23 14:06:02.315290 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 209/427] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:02 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1187 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:02.359394 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b52e7900-cf8c-4928-8600-1a05bb487529 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:02.371350 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b52e7900-cf8c-4928-8600-1a05bb487529 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1724 microversion: 2.1 time: 0.534052 Sep 23 14:06:02.371926 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 219/428] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:01 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1724 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:02.725561 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-bfb7f922-faa7-4cea-be61-5a51d5ef5fdb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:02.726160 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-bfb7f922-faa7-4cea-be61-5a51d5ef5fdb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:02.733079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bfb7f922-faa7-4cea-be61-5a51d5ef5fdb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:02.733444 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bfb7f922-faa7-4cea-be61-5a51d5ef5fdb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:02.733908 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bfb7f922-faa7-4cea-be61-5a51d5ef5fdb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:02.734794 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bfb7f922-faa7-4cea-be61-5a51d5ef5fdb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:02.735392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bfb7f922-faa7-4cea-be61-5a51d5ef5fdb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:02.735819 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bfb7f922-faa7-4cea-be61-5a51d5ef5fdb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:02.892555 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-71e0bfad-fa52-4d8c-a9ee-6c7520cec008 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:02.894922 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-71e0bfad-fa52-4d8c-a9ee-6c7520cec008 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:02.902374 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-71e0bfad-fa52-4d8c-a9ee-6c7520cec008 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:02.902857 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-71e0bfad-fa52-4d8c-a9ee-6c7520cec008 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:02.903307 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-71e0bfad-fa52-4d8c-a9ee-6c7520cec008 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:02.904740 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-71e0bfad-fa52-4d8c-a9ee-6c7520cec008 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:02.906091 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-71e0bfad-fa52-4d8c-a9ee-6c7520cec008 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:02.912217 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-71e0bfad-fa52-4d8c-a9ee-6c7520cec008 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:03.003717 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-bfb7f922-faa7-4cea-be61-5a51d5ef5fdb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:03.029537 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-bfb7f922-faa7-4cea-be61-5a51d5ef5fdb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:03.034238 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-bfb7f922-faa7-4cea-be61-5a51d5ef5fdb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:03.039384 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-bfb7f922-faa7-4cea-be61-5a51d5ef5fdb tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.318109 Sep 23 14:06:03.040035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 210/429] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:02 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:06:03.094927 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-71e0bfad-fa52-4d8c-a9ee-6c7520cec008 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:03.104973 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-71e0bfad-fa52-4d8c-a9ee-6c7520cec008 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.221273 Sep 23 14:06:03.105855 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 220/430] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:02 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:03.340726 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6b62f82d-ec32-4d9b-b1f4-07af2ac40ac5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:03.342446 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6b62f82d-ec32-4d9b-b1f4-07af2ac40ac5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:03.349616 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b62f82d-ec32-4d9b-b1f4-07af2ac40ac5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:03.350404 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b62f82d-ec32-4d9b-b1f4-07af2ac40ac5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:03.351143 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b62f82d-ec32-4d9b-b1f4-07af2ac40ac5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:03.352140 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b62f82d-ec32-4d9b-b1f4-07af2ac40ac5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:03.352777 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b62f82d-ec32-4d9b-b1f4-07af2ac40ac5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:03.353356 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b62f82d-ec32-4d9b-b1f4-07af2ac40ac5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:03.394683 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-170a33ac-3f9e-43c6-921e-83d5c66e0599 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:03.395287 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-170a33ac-3f9e-43c6-921e-83d5c66e0599 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:03.401486 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-170a33ac-3f9e-43c6-921e-83d5c66e0599 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:03.402160 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-170a33ac-3f9e-43c6-921e-83d5c66e0599 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:03.402642 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-170a33ac-3f9e-43c6-921e-83d5c66e0599 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:03.403840 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-170a33ac-3f9e-43c6-921e-83d5c66e0599 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:03.404617 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-170a33ac-3f9e-43c6-921e-83d5c66e0599 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:03.405074 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-170a33ac-3f9e-43c6-921e-83d5c66e0599 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:03.430293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6b62f82d-ec32-4d9b-b1f4-07af2ac40ac5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:03.446926 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6b62f82d-ec32-4d9b-b1f4-07af2ac40ac5 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1187 microversion: 2.1 time: 0.110069 Sep 23 14:06:03.448130 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 211/431] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:03 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1187 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:03.563632 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-170a33ac-3f9e-43c6-921e-83d5c66e0599 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:03.575566 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-170a33ac-3f9e-43c6-921e-83d5c66e0599 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1724 microversion: 2.1 time: 0.184621 Sep 23 14:06:03.576280 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 221/432] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:03 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:04.065865 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b120b832-6243-4df3-ba6a-4c42e2bdbca7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:04.066402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b120b832-6243-4df3-ba6a-4c42e2bdbca7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:04.072416 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b120b832-6243-4df3-ba6a-4c42e2bdbca7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:04.072906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b120b832-6243-4df3-ba6a-4c42e2bdbca7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:04.073345 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b120b832-6243-4df3-ba6a-4c42e2bdbca7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:04.074091 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b120b832-6243-4df3-ba6a-4c42e2bdbca7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:04.074532 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b120b832-6243-4df3-ba6a-4c42e2bdbca7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:04.081750 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b120b832-6243-4df3-ba6a-4c42e2bdbca7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:04.132513 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ce4ad521-63af-4eb2-865c-850abcf86339 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:04.133616 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ce4ad521-63af-4eb2-865c-850abcf86339 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:04.143044 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ce4ad521-63af-4eb2-865c-850abcf86339 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:04.143827 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ce4ad521-63af-4eb2-865c-850abcf86339 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:04.144275 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ce4ad521-63af-4eb2-865c-850abcf86339 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:04.144993 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ce4ad521-63af-4eb2-865c-850abcf86339 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:04.145453 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ce4ad521-63af-4eb2-865c-850abcf86339 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:04.145923 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ce4ad521-63af-4eb2-865c-850abcf86339 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:04.254607 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b120b832-6243-4df3-ba6a-4c42e2bdbca7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:04.265142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b120b832-6243-4df3-ba6a-4c42e2bdbca7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:04.266978 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b120b832-6243-4df3-ba6a-4c42e2bdbca7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:04.268176 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b120b832-6243-4df3-ba6a-4c42e2bdbca7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.206291 Sep 23 14:06:04.269070 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 212/433] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:04 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:06:04.352908 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ce4ad521-63af-4eb2-865c-850abcf86339 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:04.361689 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ce4ad521-63af-4eb2-865c-850abcf86339 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.235067 Sep 23 14:06:04.362984 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 222/434] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:04 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:04.469309 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9bd174fe-68e3-4535-aab4-e9aa1afc08b0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:04.470806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-9bd174fe-68e3-4535-aab4-e9aa1afc08b0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:04.477346 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9bd174fe-68e3-4535-aab4-e9aa1afc08b0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:04.478112 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9bd174fe-68e3-4535-aab4-e9aa1afc08b0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:04.478787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9bd174fe-68e3-4535-aab4-e9aa1afc08b0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:04.479715 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9bd174fe-68e3-4535-aab4-e9aa1afc08b0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:04.480376 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9bd174fe-68e3-4535-aab4-e9aa1afc08b0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:04.481032 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9bd174fe-68e3-4535-aab4-e9aa1afc08b0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:04.551100 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9bd174fe-68e3-4535-aab4-e9aa1afc08b0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:04.559156 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-9bd174fe-68e3-4535-aab4-e9aa1afc08b0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1187 microversion: 2.1 time: 0.093757 Sep 23 14:06:04.568353 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 213/435] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:04 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1187 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:04.598828 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8f8ad790-af0d-4b2f-a05a-625c72077520 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:04.599449 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-8f8ad790-af0d-4b2f-a05a-625c72077520 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:04.605531 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f8ad790-af0d-4b2f-a05a-625c72077520 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:04.605960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f8ad790-af0d-4b2f-a05a-625c72077520 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:04.606427 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f8ad790-af0d-4b2f-a05a-625c72077520 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:04.607145 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f8ad790-af0d-4b2f-a05a-625c72077520 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:04.608225 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f8ad790-af0d-4b2f-a05a-625c72077520 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:04.608654 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f8ad790-af0d-4b2f-a05a-625c72077520 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:04.753009 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-8f8ad790-af0d-4b2f-a05a-625c72077520 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:04.766538 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8f8ad790-af0d-4b2f-a05a-625c72077520 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1724 microversion: 2.1 time: 0.171439 Sep 23 14:06:04.767953 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 223/436] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:04 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:05.302268 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6313637d-24f2-418d-88bd-3bddb2362d7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:05.303005 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6313637d-24f2-418d-88bd-3bddb2362d7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:05.309372 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:05.311031 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6313637d-24f2-418d-88bd-3bddb2362d7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:05.311532 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6313637d-24f2-418d-88bd-3bddb2362d7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:05.311967 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6313637d-24f2-418d-88bd-3bddb2362d7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:05.312675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6313637d-24f2-418d-88bd-3bddb2362d7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:05.313128 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6313637d-24f2-418d-88bd-3bddb2362d7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:05.313553 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6313637d-24f2-418d-88bd-3bddb2362d7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:05.384679 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-dc20ea93-f844-4f05-9bb1-e04fb611b912 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:05.385641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-dc20ea93-f844-4f05-9bb1-e04fb611b912 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:05.394170 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dc20ea93-f844-4f05-9bb1-e04fb611b912 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:05.395211 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dc20ea93-f844-4f05-9bb1-e04fb611b912 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:05.395211 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dc20ea93-f844-4f05-9bb1-e04fb611b912 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:05.396045 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dc20ea93-f844-4f05-9bb1-e04fb611b912 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:05.396810 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dc20ea93-f844-4f05-9bb1-e04fb611b912 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:05.397081 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dc20ea93-f844-4f05-9bb1-e04fb611b912 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:05.512064 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6313637d-24f2-418d-88bd-3bddb2362d7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:05.525610 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6313637d-24f2-418d-88bd-3bddb2362d7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:05.527273 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6313637d-24f2-418d-88bd-3bddb2362d7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:05.528878 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6313637d-24f2-418d-88bd-3bddb2362d7f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.233740 Sep 23 14:06:05.543513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 214/437] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:05 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:06:05.581792 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b76cbc68-55f1-4326-bcd5-be6ca9fdcc56 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:05.582930 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b76cbc68-55f1-4326-bcd5-be6ca9fdcc56 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:05.584688 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-dc20ea93-f844-4f05-9bb1-e04fb611b912 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:05.589824 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b76cbc68-55f1-4326-bcd5-be6ca9fdcc56 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:05.590366 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b76cbc68-55f1-4326-bcd5-be6ca9fdcc56 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:05.590796 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b76cbc68-55f1-4326-bcd5-be6ca9fdcc56 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:05.591494 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b76cbc68-55f1-4326-bcd5-be6ca9fdcc56 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:05.592249 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b76cbc68-55f1-4326-bcd5-be6ca9fdcc56 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:05.592733 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b76cbc68-55f1-4326-bcd5-be6ca9fdcc56 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:05.598237 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-dc20ea93-f844-4f05-9bb1-e04fb611b912 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.217608 Sep 23 14:06:05.598854 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 224/438] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:05 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:05.672854 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b76cbc68-55f1-4326-bcd5-be6ca9fdcc56 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:05.681769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b76cbc68-55f1-4326-bcd5-be6ca9fdcc56 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1187 microversion: 2.1 time: 0.104247 Sep 23 14:06:05.688665 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 215/439] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:05 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1187 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:05.794495 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c8c6232b-18b3-45a6-8e05-45cb4424ad97 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:05.796260 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c8c6232b-18b3-45a6-8e05-45cb4424ad97 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:05.799628 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:05.804877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c8c6232b-18b3-45a6-8e05-45cb4424ad97 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:05.805376 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c8c6232b-18b3-45a6-8e05-45cb4424ad97 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:05.806000 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c8c6232b-18b3-45a6-8e05-45cb4424ad97 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:05.806749 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c8c6232b-18b3-45a6-8e05-45cb4424ad97 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:05.807213 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c8c6232b-18b3-45a6-8e05-45cb4424ad97 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:05.807643 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c8c6232b-18b3-45a6-8e05-45cb4424ad97 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:05.987412 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c8c6232b-18b3-45a6-8e05-45cb4424ad97 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:05.997778 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c8c6232b-18b3-45a6-8e05-45cb4424ad97 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1724 microversion: 2.1 time: 0.209293 Sep 23 14:06:05.999400 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 225/440] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:05 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:06.559267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-3c7b8d44-f2c9-4c5c-a619-17821f295394 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:06.562034 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-3c7b8d44-f2c9-4c5c-a619-17821f295394 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:06.571082 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3c7b8d44-f2c9-4c5c-a619-17821f295394 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:06.572414 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3c7b8d44-f2c9-4c5c-a619-17821f295394 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:06.573217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3c7b8d44-f2c9-4c5c-a619-17821f295394 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:06.574670 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3c7b8d44-f2c9-4c5c-a619-17821f295394 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:06.575624 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3c7b8d44-f2c9-4c5c-a619-17821f295394 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:06.576434 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3c7b8d44-f2c9-4c5c-a619-17821f295394 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:06.626060 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6d7141e4-3e0b-43db-8b5e-866575dc2049 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:06.626776 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-6d7141e4-3e0b-43db-8b5e-866575dc2049 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:06.628644 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:06.633451 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6d7141e4-3e0b-43db-8b5e-866575dc2049 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:06.633940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6d7141e4-3e0b-43db-8b5e-866575dc2049 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:06.634403 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6d7141e4-3e0b-43db-8b5e-866575dc2049 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:06.635098 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6d7141e4-3e0b-43db-8b5e-866575dc2049 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:06.635559 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6d7141e4-3e0b-43db-8b5e-866575dc2049 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:06.635987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6d7141e4-3e0b-43db-8b5e-866575dc2049 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:06.763316 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-3c7b8d44-f2c9-4c5c-a619-17821f295394 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:06.772281 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-3c7b8d44-f2c9-4c5c-a619-17821f295394 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:06.773731 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-3c7b8d44-f2c9-4c5c-a619-17821f295394 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:06.774925 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-3c7b8d44-f2c9-4c5c-a619-17821f295394 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.221245 Sep 23 14:06:06.775479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 216/441] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:06 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:06:06.784192 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-3b8ef70e-4900-4b0d-aa76-8e5f231255a3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:06.785149 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-3b8ef70e-4900-4b0d-aa76-8e5f231255a3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:06.792087 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3b8ef70e-4900-4b0d-aa76-8e5f231255a3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:06.792894 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3b8ef70e-4900-4b0d-aa76-8e5f231255a3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:06.793538 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3b8ef70e-4900-4b0d-aa76-8e5f231255a3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:06.794518 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3b8ef70e-4900-4b0d-aa76-8e5f231255a3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:06.795745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3b8ef70e-4900-4b0d-aa76-8e5f231255a3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:06.796631 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3b8ef70e-4900-4b0d-aa76-8e5f231255a3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:06.858583 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-6d7141e4-3e0b-43db-8b5e-866575dc2049 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:06.868691 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-6d7141e4-3e0b-43db-8b5e-866575dc2049 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.247073 Sep 23 14:06:06.870238 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 226/442] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:06 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:06.885533 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-3b8ef70e-4900-4b0d-aa76-8e5f231255a3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:06.894016 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-3b8ef70e-4900-4b0d-aa76-8e5f231255a3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1187 microversion: 2.1 time: 0.117462 Sep 23 14:06:06.894639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 217/443] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:06 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1187 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:07.025105 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-584bd0c3-880d-4a88-998f-b55c533cbdf6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:07.025712 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-584bd0c3-880d-4a88-998f-b55c533cbdf6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:07.032033 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-584bd0c3-880d-4a88-998f-b55c533cbdf6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:07.032545 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-584bd0c3-880d-4a88-998f-b55c533cbdf6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:07.032981 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-584bd0c3-880d-4a88-998f-b55c533cbdf6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:07.033661 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-584bd0c3-880d-4a88-998f-b55c533cbdf6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:07.034113 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-584bd0c3-880d-4a88-998f-b55c533cbdf6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:07.034567 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-584bd0c3-880d-4a88-998f-b55c533cbdf6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:07.173499 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-584bd0c3-880d-4a88-998f-b55c533cbdf6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:07.181956 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-584bd0c3-880d-4a88-998f-b55c533cbdf6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1724 microversion: 2.1 time: 0.160826 Sep 23 14:06:07.182544 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 227/444] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:07 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:07.813128 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-45af12c5-0701-48c3-acdd-abc29ccb7076 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:07.813742 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-45af12c5-0701-48c3-acdd-abc29ccb7076 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:07.815596 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:07.816276 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=10 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:07.821132 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-45af12c5-0701-48c3-acdd-abc29ccb7076 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:07.821561 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-45af12c5-0701-48c3-acdd-abc29ccb7076 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:07.821997 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-45af12c5-0701-48c3-acdd-abc29ccb7076 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:07.822735 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-45af12c5-0701-48c3-acdd-abc29ccb7076 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:07.823190 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-45af12c5-0701-48c3-acdd-abc29ccb7076 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:07.823681 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-45af12c5-0701-48c3-acdd-abc29ccb7076 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:07.893964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-beb003b5-fe22-4b7b-9381-479b91fb5094 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:07.895268 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-beb003b5-fe22-4b7b-9381-479b91fb5094 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:07.898148 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=12 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:07.902459 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-beb003b5-fe22-4b7b-9381-479b91fb5094 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:07.903068 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-beb003b5-fe22-4b7b-9381-479b91fb5094 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:07.903512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-beb003b5-fe22-4b7b-9381-479b91fb5094 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:07.904263 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-beb003b5-fe22-4b7b-9381-479b91fb5094 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:07.905706 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-beb003b5-fe22-4b7b-9381-479b91fb5094 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:07.906185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-beb003b5-fe22-4b7b-9381-479b91fb5094 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:08.018059 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-45af12c5-0701-48c3-acdd-abc29ccb7076 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:08.028100 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-45af12c5-0701-48c3-acdd-abc29ccb7076 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:08.031352 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-45af12c5-0701-48c3-acdd-abc29ccb7076 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:08.033348 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-45af12c5-0701-48c3-acdd-abc29ccb7076 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.225000 Sep 23 14:06:08.034539 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 218/445] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:07 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:06:08.039898 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9acd7783-7173-4619-ae70-017afa9a1c1d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:08.040804 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-9acd7783-7173-4619-ae70-017afa9a1c1d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:08.048489 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9acd7783-7173-4619-ae70-017afa9a1c1d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:08.049603 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9acd7783-7173-4619-ae70-017afa9a1c1d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:08.050286 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9acd7783-7173-4619-ae70-017afa9a1c1d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:08.051248 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9acd7783-7173-4619-ae70-017afa9a1c1d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:08.051930 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9acd7783-7173-4619-ae70-017afa9a1c1d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:08.052578 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9acd7783-7173-4619-ae70-017afa9a1c1d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:08.158895 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9acd7783-7173-4619-ae70-017afa9a1c1d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:08.162010 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-beb003b5-fe22-4b7b-9381-479b91fb5094 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:08.169262 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-9acd7783-7173-4619-ae70-017afa9a1c1d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1187 microversion: 2.1 time: 0.133103 Sep 23 14:06:08.171508 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-beb003b5-fe22-4b7b-9381-479b91fb5094 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.280046 Sep 23 14:06:08.171624 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 219/446] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:08 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1187 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:08.171713 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 228/447] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:07 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:08.208903 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-621fcd55-791b-4219-9632-55952238198f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:08.209509 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-621fcd55-791b-4219-9632-55952238198f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:08.215826 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-621fcd55-791b-4219-9632-55952238198f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:08.217557 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-621fcd55-791b-4219-9632-55952238198f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:08.217557 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-621fcd55-791b-4219-9632-55952238198f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:08.218562 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-621fcd55-791b-4219-9632-55952238198f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:08.219031 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-621fcd55-791b-4219-9632-55952238198f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:08.219455 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-621fcd55-791b-4219-9632-55952238198f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:08.365669 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-621fcd55-791b-4219-9632-55952238198f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:08.374544 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-621fcd55-791b-4219-9632-55952238198f tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1724 microversion: 2.1 time: 0.169903 Sep 23 14:06:08.375951 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 220/448] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:08 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:09.059998 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ec45d9aa-3f28-4a28-a477-9827489c65e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:09.061182 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ec45d9aa-3f28-4a28-a477-9827489c65e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:09.067575 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ec45d9aa-3f28-4a28-a477-9827489c65e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:09.068065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ec45d9aa-3f28-4a28-a477-9827489c65e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:09.068507 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ec45d9aa-3f28-4a28-a477-9827489c65e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:09.069204 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ec45d9aa-3f28-4a28-a477-9827489c65e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:09.069668 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ec45d9aa-3f28-4a28-a477-9827489c65e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:09.070099 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ec45d9aa-3f28-4a28-a477-9827489c65e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:09.192984 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-80551228-e204-4ea6-ab3e-548f5d7df150 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:09.193600 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-80551228-e204-4ea6-ab3e-548f5d7df150 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:09.199636 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-80551228-e204-4ea6-ab3e-548f5d7df150 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:09.203291 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-80551228-e204-4ea6-ab3e-548f5d7df150 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:09.203291 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-80551228-e204-4ea6-ab3e-548f5d7df150 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:09.203291 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-80551228-e204-4ea6-ab3e-548f5d7df150 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:09.203291 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-80551228-e204-4ea6-ab3e-548f5d7df150 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:09.203625 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-80551228-e204-4ea6-ab3e-548f5d7df150 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:09.206928 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=100 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:09.225027 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ec45d9aa-3f28-4a28-a477-9827489c65e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:09.238294 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ec45d9aa-3f28-4a28-a477-9827489c65e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:09.239766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ec45d9aa-3f28-4a28-a477-9827489c65e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:09.240988 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ec45d9aa-3f28-4a28-a477-9827489c65e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.184851 Sep 23 14:06:09.241856 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 229/449] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:09 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:06:09.246760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-db4872a4-bf81-4a01-82d3-79be7ac7e295 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:09.247415 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-db4872a4-bf81-4a01-82d3-79be7ac7e295 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:09.254295 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-db4872a4-bf81-4a01-82d3-79be7ac7e295 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:09.256013 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-db4872a4-bf81-4a01-82d3-79be7ac7e295 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:09.256013 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-db4872a4-bf81-4a01-82d3-79be7ac7e295 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:09.256013 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-db4872a4-bf81-4a01-82d3-79be7ac7e295 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:09.256429 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-db4872a4-bf81-4a01-82d3-79be7ac7e295 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:09.256936 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-db4872a4-bf81-4a01-82d3-79be7ac7e295 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:09.261796 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:09.288054 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-80551228-e204-4ea6-ab3e-548f5d7df150 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:09.296815 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-80551228-e204-4ea6-ab3e-548f5d7df150 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1187 microversion: 2.1 time: 0.107661 Sep 23 14:06:09.297581 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 221/450] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:09 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1187 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:09.399857 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-68fed6aa-2c83-4fdf-99f0-b97bbd2ff0ad tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:09.401224 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-68fed6aa-2c83-4fdf-99f0-b97bbd2ff0ad tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:09.408984 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-68fed6aa-2c83-4fdf-99f0-b97bbd2ff0ad tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:09.409484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-68fed6aa-2c83-4fdf-99f0-b97bbd2ff0ad tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:09.409979 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-68fed6aa-2c83-4fdf-99f0-b97bbd2ff0ad tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:09.410770 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-68fed6aa-2c83-4fdf-99f0-b97bbd2ff0ad tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:09.411184 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-68fed6aa-2c83-4fdf-99f0-b97bbd2ff0ad tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:09.411611 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-68fed6aa-2c83-4fdf-99f0-b97bbd2ff0ad tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:09.426153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-db4872a4-bf81-4a01-82d3-79be7ac7e295 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:09.434725 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-db4872a4-bf81-4a01-82d3-79be7ac7e295 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.191636 Sep 23 14:06:09.435306 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 230/451] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:09 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:09.560036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-68fed6aa-2c83-4fdf-99f0-b97bbd2ff0ad tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:09.568584 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-68fed6aa-2c83-4fdf-99f0-b97bbd2ff0ad tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1724 microversion: 2.1 time: 0.173943 Sep 23 14:06:09.569137 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 222/452] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:09 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:10.268682 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-695b9f8d-a777-4662-b99a-e69d11d86712 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:10.269313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-695b9f8d-a777-4662-b99a-e69d11d86712 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:10.275690 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-695b9f8d-a777-4662-b99a-e69d11d86712 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:10.276179 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-695b9f8d-a777-4662-b99a-e69d11d86712 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:10.276619 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-695b9f8d-a777-4662-b99a-e69d11d86712 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:10.277306 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-695b9f8d-a777-4662-b99a-e69d11d86712 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:10.277792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-695b9f8d-a777-4662-b99a-e69d11d86712 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:10.278221 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-695b9f8d-a777-4662-b99a-e69d11d86712 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:10.320051 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-420bca0e-4630-495a-813d-daac36e23cf4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:10.320669 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-420bca0e-4630-495a-813d-daac36e23cf4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:10.327705 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-420bca0e-4630-495a-813d-daac36e23cf4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:10.327940 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-420bca0e-4630-495a-813d-daac36e23cf4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:10.328201 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-420bca0e-4630-495a-813d-daac36e23cf4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:10.328896 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-420bca0e-4630-495a-813d-daac36e23cf4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:10.329346 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-420bca0e-4630-495a-813d-daac36e23cf4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:10.329762 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-420bca0e-4630-495a-813d-daac36e23cf4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:10.406206 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-420bca0e-4630-495a-813d-daac36e23cf4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:10.413807 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-420bca0e-4630-495a-813d-daac36e23cf4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1187 microversion: 2.1 time: 0.097570 Sep 23 14:06:10.414387 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 223/453] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:10 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1187 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:10.435472 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-695b9f8d-a777-4662-b99a-e69d11d86712 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:10.444393 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-695b9f8d-a777-4662-b99a-e69d11d86712 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:10.445847 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-695b9f8d-a777-4662-b99a-e69d11d86712 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:10.447045 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-695b9f8d-a777-4662-b99a-e69d11d86712 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.182998 Sep 23 14:06:10.447592 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 231/454] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:10 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:06:10.458484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7286eea9-5b6c-4cb8-8381-720158a1953a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:10.459091 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7286eea9-5b6c-4cb8-8381-720158a1953a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:10.464897 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7286eea9-5b6c-4cb8-8381-720158a1953a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:10.465376 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7286eea9-5b6c-4cb8-8381-720158a1953a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:10.465812 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7286eea9-5b6c-4cb8-8381-720158a1953a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:10.466586 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7286eea9-5b6c-4cb8-8381-720158a1953a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:10.467005 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7286eea9-5b6c-4cb8-8381-720158a1953a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:10.467527 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7286eea9-5b6c-4cb8-8381-720158a1953a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:10.592042 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-2d3b4ccd-ad40-40bc-8969-c7fe8374d947 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:10.592791 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-2d3b4ccd-ad40-40bc-8969-c7fe8374d947 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:10.597574 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7286eea9-5b6c-4cb8-8381-720158a1953a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:10.608416 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7286eea9-5b6c-4cb8-8381-720158a1953a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.153323 Sep 23 14:06:10.613043 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2d3b4ccd-ad40-40bc-8969-c7fe8374d947 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:10.613854 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2d3b4ccd-ad40-40bc-8969-c7fe8374d947 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:10.615214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2d3b4ccd-ad40-40bc-8969-c7fe8374d947 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:10.617555 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2d3b4ccd-ad40-40bc-8969-c7fe8374d947 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:10.618128 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2d3b4ccd-ad40-40bc-8969-c7fe8374d947 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:10.618661 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2d3b4ccd-ad40-40bc-8969-c7fe8374d947 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:10.622384 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 224/455] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:10 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:10.888997 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-2d3b4ccd-ad40-40bc-8969-c7fe8374d947 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:10.897560 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-2d3b4ccd-ad40-40bc-8969-c7fe8374d947 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1724 microversion: 2.1 time: 0.309597 Sep 23 14:06:10.898148 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 232/456] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:10 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:11.438429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-cf7ad453-ff04-41be-95f4-e70ec006e69e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:11.439048 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-cf7ad453-ff04-41be-95f4-e70ec006e69e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:11.449325 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cf7ad453-ff04-41be-95f4-e70ec006e69e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:11.450026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cf7ad453-ff04-41be-95f4-e70ec006e69e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:11.450519 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cf7ad453-ff04-41be-95f4-e70ec006e69e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:11.451465 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cf7ad453-ff04-41be-95f4-e70ec006e69e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:11.452318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cf7ad453-ff04-41be-95f4-e70ec006e69e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:11.453664 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cf7ad453-ff04-41be-95f4-e70ec006e69e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:11.473829 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f701a4cc-2a07-479f-bea8-65a958360319 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:11.475875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f701a4cc-2a07-479f-bea8-65a958360319 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:11.489422 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f701a4cc-2a07-479f-bea8-65a958360319 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:11.490126 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f701a4cc-2a07-479f-bea8-65a958360319 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:11.490803 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f701a4cc-2a07-479f-bea8-65a958360319 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:11.494381 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f701a4cc-2a07-479f-bea8-65a958360319 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:11.494381 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f701a4cc-2a07-479f-bea8-65a958360319 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:11.495869 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f701a4cc-2a07-479f-bea8-65a958360319 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:11.603878 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-cf7ad453-ff04-41be-95f4-e70ec006e69e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:11.612030 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-cf7ad453-ff04-41be-95f4-e70ec006e69e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1205 microversion: 2.1 time: 0.178902 Sep 23 14:06:11.612605 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 225/457] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:11 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1205 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:11.654878 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-84bc76ed-29ef-456f-b2d2-985ddf2d73da tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:11.656813 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-84bc76ed-29ef-456f-b2d2-985ddf2d73da tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:11.684660 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-84bc76ed-29ef-456f-b2d2-985ddf2d73da tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:11.687899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-84bc76ed-29ef-456f-b2d2-985ddf2d73da tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:11.688586 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-84bc76ed-29ef-456f-b2d2-985ddf2d73da tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:11.690089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-84bc76ed-29ef-456f-b2d2-985ddf2d73da tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:11.690702 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-84bc76ed-29ef-456f-b2d2-985ddf2d73da tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:11.691248 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-84bc76ed-29ef-456f-b2d2-985ddf2d73da tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:11.863425 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f701a4cc-2a07-479f-bea8-65a958360319 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:11.872336 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f701a4cc-2a07-479f-bea8-65a958360319 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:11.874470 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f701a4cc-2a07-479f-bea8-65a958360319 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:11.875682 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f701a4cc-2a07-479f-bea8-65a958360319 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.405727 Sep 23 14:06:11.876238 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 233/458] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:11 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:06:11.901035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-84bc76ed-29ef-456f-b2d2-985ddf2d73da tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:11.909462 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-84bc76ed-29ef-456f-b2d2-985ddf2d73da tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.263734 Sep 23 14:06:11.910032 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 226/459] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:11 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:11.921800 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4a837d1b-7942-4a57-88b1-8823b9ae93e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:11.922445 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4a837d1b-7942-4a57-88b1-8823b9ae93e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:11.933080 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a837d1b-7942-4a57-88b1-8823b9ae93e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:11.933080 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a837d1b-7942-4a57-88b1-8823b9ae93e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:11.933080 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a837d1b-7942-4a57-88b1-8823b9ae93e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:11.933080 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a837d1b-7942-4a57-88b1-8823b9ae93e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:11.933618 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a837d1b-7942-4a57-88b1-8823b9ae93e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:11.933618 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a837d1b-7942-4a57-88b1-8823b9ae93e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:12.057964 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-e19c488f-d4b8-4c93-8cc9-44b5e177ac5a req-9b29668b-2b81-4c05-9b19-8c792fcdca9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eee99559-a86f-4088-9fd1-a6ae97245d92", "tag": "57f85532-237c-4ac3-8270-603ea7e41e29"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:06:12.068225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-e19c488f-d4b8-4c93-8cc9-44b5e177ac5a req-9b29668b-2b81-4c05-9b19-8c792fcdca9a service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:12.068708 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-e19c488f-d4b8-4c93-8cc9-44b5e177ac5a req-9b29668b-2b81-4c05-9b19-8c792fcdca9a service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:12.069158 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-e19c488f-d4b8-4c93-8cc9-44b5e177ac5a req-9b29668b-2b81-4c05-9b19-8c792fcdca9a service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:12.080902 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-e19c488f-d4b8-4c93-8cc9-44b5e177ac5a req-9b29668b-2b81-4c05-9b19-8c792fcdca9a service nova] Creating event network-changed:57f85532-237c-4ac3-8270-603ea7e41e29 for instance eee99559-a86f-4088-9fd1-a6ae97245d92 on hv-cinder-85743 Sep 23 14:06:12.085887 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-e19c488f-d4b8-4c93-8cc9-44b5e177ac5a req-9b29668b-2b81-4c05-9b19-8c792fcdca9a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031627 Sep 23 14:06:12.087149 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 227/460] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:06:12.214637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4a837d1b-7942-4a57-88b1-8823b9ae93e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:12.223999 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4a837d1b-7942-4a57-88b1-8823b9ae93e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1724 microversion: 2.1 time: 0.306795 Sep 23 14:06:12.224574 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 234/461] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:11 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:12.700422 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-296cce83-a39a-477c-8a78-a2b0174133f0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:12.701117 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-296cce83-a39a-477c-8a78-a2b0174133f0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:12.707926 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-296cce83-a39a-477c-8a78-a2b0174133f0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:12.708417 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-296cce83-a39a-477c-8a78-a2b0174133f0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:12.708848 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-296cce83-a39a-477c-8a78-a2b0174133f0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:12.709536 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-296cce83-a39a-477c-8a78-a2b0174133f0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:12.710045 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-296cce83-a39a-477c-8a78-a2b0174133f0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:12.710500 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-296cce83-a39a-477c-8a78-a2b0174133f0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:12.839983 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-296cce83-a39a-477c-8a78-a2b0174133f0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:12.847521 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-296cce83-a39a-477c-8a78-a2b0174133f0 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1272 microversion: 2.1 time: 0.153932 Sep 23 14:06:12.848074 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 228/462] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:12 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:12.901153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-457b782a-2cbd-49f6-9909-ada5046a2373 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:12.901731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-457b782a-2cbd-49f6-9909-ada5046a2373 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:12.908153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-457b782a-2cbd-49f6-9909-ada5046a2373 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:12.908641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-457b782a-2cbd-49f6-9909-ada5046a2373 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:12.909083 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-457b782a-2cbd-49f6-9909-ada5046a2373 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:12.909773 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-457b782a-2cbd-49f6-9909-ada5046a2373 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:12.910236 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-457b782a-2cbd-49f6-9909-ada5046a2373 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:12.910695 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-457b782a-2cbd-49f6-9909-ada5046a2373 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:12.932958 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7621b3a8-7d2e-44c0-9114-866ca8d280ac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:12.933565 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7621b3a8-7d2e-44c0-9114-866ca8d280ac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:12.940410 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7621b3a8-7d2e-44c0-9114-866ca8d280ac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:12.940904 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7621b3a8-7d2e-44c0-9114-866ca8d280ac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:12.941370 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7621b3a8-7d2e-44c0-9114-866ca8d280ac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:12.942069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7621b3a8-7d2e-44c0-9114-866ca8d280ac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:12.942567 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7621b3a8-7d2e-44c0-9114-866ca8d280ac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:12.942997 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7621b3a8-7d2e-44c0-9114-866ca8d280ac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:13.095902 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-457b782a-2cbd-49f6-9909-ada5046a2373 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:13.104817 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-457b782a-2cbd-49f6-9909-ada5046a2373 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:13.106176 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-457b782a-2cbd-49f6-9909-ada5046a2373 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:13.107460 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-457b782a-2cbd-49f6-9909-ada5046a2373 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.210248 Sep 23 14:06:13.118472 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 235/463] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:12 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:06:13.146823 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7621b3a8-7d2e-44c0-9114-866ca8d280ac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:13.154643 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7621b3a8-7d2e-44c0-9114-866ca8d280ac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.225495 Sep 23 14:06:13.155704 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 229/464] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:12 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:13.248324 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b10ad771-ec42-4bb4-a86b-26aac4e00f60 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:13.249552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b10ad771-ec42-4bb4-a86b-26aac4e00f60 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:13.255467 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b10ad771-ec42-4bb4-a86b-26aac4e00f60 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:13.255946 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b10ad771-ec42-4bb4-a86b-26aac4e00f60 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:13.256378 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b10ad771-ec42-4bb4-a86b-26aac4e00f60 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:13.257092 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b10ad771-ec42-4bb4-a86b-26aac4e00f60 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:13.257543 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b10ad771-ec42-4bb4-a86b-26aac4e00f60 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:13.257964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b10ad771-ec42-4bb4-a86b-26aac4e00f60 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:13.509933 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b10ad771-ec42-4bb4-a86b-26aac4e00f60 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:13.518642 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b10ad771-ec42-4bb4-a86b-26aac4e00f60 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1724 microversion: 2.1 time: 0.274328 Sep 23 14:06:13.521524 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 236/465] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:13 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:13.869168 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e6cd8421-b5e3-488e-841f-2926e468d7ac tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:13.869780 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e6cd8421-b5e3-488e-841f-2926e468d7ac tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:13.875786 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e6cd8421-b5e3-488e-841f-2926e468d7ac tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:13.880386 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e6cd8421-b5e3-488e-841f-2926e468d7ac tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:13.880386 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e6cd8421-b5e3-488e-841f-2926e468d7ac tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:13.880386 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e6cd8421-b5e3-488e-841f-2926e468d7ac tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:13.880386 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e6cd8421-b5e3-488e-841f-2926e468d7ac tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:13.880871 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e6cd8421-b5e3-488e-841f-2926e468d7ac tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:14.134671 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-310a6f2a-b7e2-4e00-a1b7-462760a0f999 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:14.135391 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-310a6f2a-b7e2-4e00-a1b7-462760a0f999 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:14.142787 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-310a6f2a-b7e2-4e00-a1b7-462760a0f999 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:14.143367 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-310a6f2a-b7e2-4e00-a1b7-462760a0f999 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:14.143879 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-310a6f2a-b7e2-4e00-a1b7-462760a0f999 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:14.144705 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-310a6f2a-b7e2-4e00-a1b7-462760a0f999 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:14.145226 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-310a6f2a-b7e2-4e00-a1b7-462760a0f999 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:14.145725 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-310a6f2a-b7e2-4e00-a1b7-462760a0f999 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:14.285233 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e6cd8421-b5e3-488e-841f-2926e468d7ac tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:14.293235 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e6cd8421-b5e3-488e-841f-2926e468d7ac tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1272 microversion: 2.1 time: 0.428062 Sep 23 14:06:14.293907 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 230/466] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:13 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1272 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:14.298564 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ee9b8416-bd5f-4af9-b602-5093a807890d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:14.299257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ee9b8416-bd5f-4af9-b602-5093a807890d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:14.306835 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee9b8416-bd5f-4af9-b602-5093a807890d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:14.307364 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee9b8416-bd5f-4af9-b602-5093a807890d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:14.307876 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee9b8416-bd5f-4af9-b602-5093a807890d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:14.310002 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee9b8416-bd5f-4af9-b602-5093a807890d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:14.310598 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee9b8416-bd5f-4af9-b602-5093a807890d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:14.311613 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee9b8416-bd5f-4af9-b602-5093a807890d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:14.488542 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-310a6f2a-b7e2-4e00-a1b7-462760a0f999 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:14.498159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-310a6f2a-b7e2-4e00-a1b7-462760a0f999 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:14.500420 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-310a6f2a-b7e2-4e00-a1b7-462760a0f999 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:14.501811 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-310a6f2a-b7e2-4e00-a1b7-462760a0f999 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.371368 Sep 23 14:06:14.502380 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 237/467] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:14 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:06:14.542834 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5396adf1-d76e-4811-bda8-c308778b0c82 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:14.543473 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5396adf1-d76e-4811-bda8-c308778b0c82 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:14.550213 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5396adf1-d76e-4811-bda8-c308778b0c82 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:14.550761 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5396adf1-d76e-4811-bda8-c308778b0c82 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:14.551197 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5396adf1-d76e-4811-bda8-c308778b0c82 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:14.551884 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5396adf1-d76e-4811-bda8-c308778b0c82 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:14.552336 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5396adf1-d76e-4811-bda8-c308778b0c82 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:14.552756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5396adf1-d76e-4811-bda8-c308778b0c82 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:14.597946 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ee9b8416-bd5f-4af9-b602-5093a807890d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:14.605566 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ee9b8416-bd5f-4af9-b602-5093a807890d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.310591 Sep 23 14:06:14.606134 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 231/468] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:14 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:14.790078 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5396adf1-d76e-4811-bda8-c308778b0c82 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:14.798418 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5396adf1-d76e-4811-bda8-c308778b0c82 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1730 microversion: 2.1 time: 0.259342 Sep 23 14:06:14.813784 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 238/469] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:14 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1730 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:14.823071 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0a030de4-1ecd-440a-a5b8-ca92bdabc01b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:14.823661 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-0a030de4-1ecd-440a-a5b8-ca92bdabc01b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:14.830569 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0a030de4-1ecd-440a-a5b8-ca92bdabc01b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:14.831061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0a030de4-1ecd-440a-a5b8-ca92bdabc01b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:14.831703 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0a030de4-1ecd-440a-a5b8-ca92bdabc01b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:14.832395 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0a030de4-1ecd-440a-a5b8-ca92bdabc01b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:14.832849 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0a030de4-1ecd-440a-a5b8-ca92bdabc01b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:14.833271 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0a030de4-1ecd-440a-a5b8-ca92bdabc01b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:14.851761 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-0a04fbe9-6e69-44c6-b24a-f824c75b0173 req-da8ff79a-5923-4f5e-b7bc-6c458d7c36bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3cf38f-b2d0-465c-9f91-7b04e669be1a", "tag": "ddb61f77-2e1f-4d02-bd20-42e3ca25c62d"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:06:14.863436 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-0a04fbe9-6e69-44c6-b24a-f824c75b0173 req-da8ff79a-5923-4f5e-b7bc-6c458d7c36bc service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:14.864372 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-0a04fbe9-6e69-44c6-b24a-f824c75b0173 req-da8ff79a-5923-4f5e-b7bc-6c458d7c36bc service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:14.865002 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-0a04fbe9-6e69-44c6-b24a-f824c75b0173 req-da8ff79a-5923-4f5e-b7bc-6c458d7c36bc service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:14.878741 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-0a04fbe9-6e69-44c6-b24a-f824c75b0173 req-da8ff79a-5923-4f5e-b7bc-6c458d7c36bc service nova] Creating event network-changed:ddb61f77-2e1f-4d02-bd20-42e3ca25c62d for instance ae3cf38f-b2d0-465c-9f91-7b04e669be1a on hv-cinder-85743 Sep 23 14:06:14.884695 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-0a04fbe9-6e69-44c6-b24a-f824c75b0173 req-da8ff79a-5923-4f5e-b7bc-6c458d7c36bc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037151 Sep 23 14:06:14.885297 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 239/470] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:06:14.933170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-0a030de4-1ecd-440a-a5b8-ca92bdabc01b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114041 Sep 23 14:06:14.933765 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 232/471] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 23 14:06:14 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:06:15.320886 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-93374ab6-e664-4938-b3ec-48eccc76e07b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:15.322486 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-93374ab6-e664-4938-b3ec-48eccc76e07b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:15.331325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93374ab6-e664-4938-b3ec-48eccc76e07b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:15.331917 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93374ab6-e664-4938-b3ec-48eccc76e07b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:15.332404 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93374ab6-e664-4938-b3ec-48eccc76e07b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:15.333246 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93374ab6-e664-4938-b3ec-48eccc76e07b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:15.339458 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93374ab6-e664-4938-b3ec-48eccc76e07b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:15.339458 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93374ab6-e664-4938-b3ec-48eccc76e07b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:15.528152 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b8115123-f8b1-409b-8723-afbd4b9c68b0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:15.528761 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b8115123-f8b1-409b-8723-afbd4b9c68b0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:15.534821 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8115123-f8b1-409b-8723-afbd4b9c68b0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:15.535315 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8115123-f8b1-409b-8723-afbd4b9c68b0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:15.535755 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8115123-f8b1-409b-8723-afbd4b9c68b0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:15.536482 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8115123-f8b1-409b-8723-afbd4b9c68b0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:15.536944 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8115123-f8b1-409b-8723-afbd4b9c68b0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:15.537369 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8115123-f8b1-409b-8723-afbd4b9c68b0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:16.025140 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-93374ab6-e664-4938-b3ec-48eccc76e07b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:16.033850 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-93374ab6-e664-4938-b3ec-48eccc76e07b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1260 microversion: 2.1 time: 0.719131 Sep 23 14:06:16.046569 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 240/472] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:15 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1260 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:16.056529 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-72fb8709-56ed-4d0a-9c41-1db86b7f0672 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:16.057167 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-72fb8709-56ed-4d0a-9c41-1db86b7f0672 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:16.064516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-72fb8709-56ed-4d0a-9c41-1db86b7f0672 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:16.065065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-72fb8709-56ed-4d0a-9c41-1db86b7f0672 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:16.065521 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-72fb8709-56ed-4d0a-9c41-1db86b7f0672 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:16.066392 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-72fb8709-56ed-4d0a-9c41-1db86b7f0672 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:16.066866 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-72fb8709-56ed-4d0a-9c41-1db86b7f0672 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:16.068186 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-72fb8709-56ed-4d0a-9c41-1db86b7f0672 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:16.252827 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b8115123-f8b1-409b-8723-afbd4b9c68b0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:16.261309 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b8115123-f8b1-409b-8723-afbd4b9c68b0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:16.262771 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b8115123-f8b1-409b-8723-afbd4b9c68b0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:16.263921 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b8115123-f8b1-409b-8723-afbd4b9c68b0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.739662 Sep 23 14:06:16.265152 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 233/473] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:15 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:06:16.337491 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-72fb8709-56ed-4d0a-9c41-1db86b7f0672 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:16.345475 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-72fb8709-56ed-4d0a-9c41-1db86b7f0672 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.297889 Sep 23 14:06:16.346034 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 241/474] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:16 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:16.915739 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-eceae07c-bc3c-4b5d-afd4-8d1d282b1422 req-fed2852b-f141-4af0-9fa3-05725542d2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6891295c-5fe6-44a7-adf2-f1fb03036261", "tag": "51f6ed4d-0d8a-4bb4-bf7b-e42a43e05409"}, {"name": "network-changed", "server_uuid": "6891295c-5fe6-44a7-adf2-f1fb03036261", "tag": "51f6ed4d-0d8a-4bb4-bf7b-e42a43e05409"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:06:16.925872 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-eceae07c-bc3c-4b5d-afd4-8d1d282b1422 req-fed2852b-f141-4af0-9fa3-05725542d2b7 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:16.926491 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-eceae07c-bc3c-4b5d-afd4-8d1d282b1422 req-fed2852b-f141-4af0-9fa3-05725542d2b7 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:16.926926 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-eceae07c-bc3c-4b5d-afd4-8d1d282b1422 req-fed2852b-f141-4af0-9fa3-05725542d2b7 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:16.938524 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-eceae07c-bc3c-4b5d-afd4-8d1d282b1422 req-fed2852b-f141-4af0-9fa3-05725542d2b7 service nova] Creating event network-changed:51f6ed4d-0d8a-4bb4-bf7b-e42a43e05409 for instance 6891295c-5fe6-44a7-adf2-f1fb03036261 on hv-cinder-85743 Sep 23 14:06:16.939034 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-eceae07c-bc3c-4b5d-afd4-8d1d282b1422 req-fed2852b-f141-4af0-9fa3-05725542d2b7 service nova] Creating event network-changed:51f6ed4d-0d8a-4bb4-bf7b-e42a43e05409 for instance 6891295c-5fe6-44a7-adf2-f1fb03036261 on hv-cinder-85743 Sep 23 14:06:16.944258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-eceae07c-bc3c-4b5d-afd4-8d1d282b1422 req-fed2852b-f141-4af0-9fa3-05725542d2b7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032106 Sep 23 14:06:16.944869 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 234/475] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:06:17.061199 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-996d7332-da95-4c87-9afd-c17b73d6f83b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:17.061819 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-996d7332-da95-4c87-9afd-c17b73d6f83b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:17.067817 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-996d7332-da95-4c87-9afd-c17b73d6f83b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:17.068393 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-996d7332-da95-4c87-9afd-c17b73d6f83b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:17.068833 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-996d7332-da95-4c87-9afd-c17b73d6f83b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:17.069525 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-996d7332-da95-4c87-9afd-c17b73d6f83b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:17.069980 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-996d7332-da95-4c87-9afd-c17b73d6f83b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:17.070429 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-996d7332-da95-4c87-9afd-c17b73d6f83b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:17.206190 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-996d7332-da95-4c87-9afd-c17b73d6f83b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:17.214430 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-996d7332-da95-4c87-9afd-c17b73d6f83b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1260 microversion: 2.1 time: 0.157021 Sep 23 14:06:17.215186 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 242/476] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:17 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:17.295029 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d977645d-4e91-44d8-851a-661afd0a4a31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:17.296449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d977645d-4e91-44d8-851a-661afd0a4a31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:17.303852 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d977645d-4e91-44d8-851a-661afd0a4a31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:17.304392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d977645d-4e91-44d8-851a-661afd0a4a31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:17.305180 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d977645d-4e91-44d8-851a-661afd0a4a31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:17.305867 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d977645d-4e91-44d8-851a-661afd0a4a31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:17.306352 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d977645d-4e91-44d8-851a-661afd0a4a31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:17.306784 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d977645d-4e91-44d8-851a-661afd0a4a31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:17.369029 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c52fed52-9b4e-4eca-9615-6a56a727e216 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:17.369642 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c52fed52-9b4e-4eca-9615-6a56a727e216 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:17.385339 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c52fed52-9b4e-4eca-9615-6a56a727e216 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:17.385833 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c52fed52-9b4e-4eca-9615-6a56a727e216 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:17.386268 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c52fed52-9b4e-4eca-9615-6a56a727e216 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:17.386994 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c52fed52-9b4e-4eca-9615-6a56a727e216 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:17.387453 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c52fed52-9b4e-4eca-9615-6a56a727e216 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:17.387937 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c52fed52-9b4e-4eca-9615-6a56a727e216 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:17.509316 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d977645d-4e91-44d8-851a-661afd0a4a31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:17.519243 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d977645d-4e91-44d8-851a-661afd0a4a31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:17.520895 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d977645d-4e91-44d8-851a-661afd0a4a31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:17.522118 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d977645d-4e91-44d8-851a-661afd0a4a31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.231429 Sep 23 14:06:17.522701 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 235/477] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:17 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:06:17.557992 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c52fed52-9b4e-4eca-9615-6a56a727e216 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:17.566420 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c52fed52-9b4e-4eca-9615-6a56a727e216 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.201279 Sep 23 14:06:17.566981 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 243/478] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:17 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:18.237615 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-778fbe49-60f1-4216-a12c-20ec7a558429 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:18.238224 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-778fbe49-60f1-4216-a12c-20ec7a558429 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:18.244552 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-778fbe49-60f1-4216-a12c-20ec7a558429 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:18.245046 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-778fbe49-60f1-4216-a12c-20ec7a558429 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:18.245462 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-778fbe49-60f1-4216-a12c-20ec7a558429 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:18.246136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-778fbe49-60f1-4216-a12c-20ec7a558429 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:18.246614 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-778fbe49-60f1-4216-a12c-20ec7a558429 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:18.247034 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-778fbe49-60f1-4216-a12c-20ec7a558429 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:18.545840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-778fbe49-60f1-4216-a12c-20ec7a558429 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:18.548193 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ef230ab6-c56b-4fcd-a7d4-259b7504167b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:18.548702 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ef230ab6-c56b-4fcd-a7d4-259b7504167b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:18.555366 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ef230ab6-c56b-4fcd-a7d4-259b7504167b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:18.555561 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-778fbe49-60f1-4216-a12c-20ec7a558429 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1260 microversion: 2.1 time: 0.322203 Sep 23 14:06:18.555863 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ef230ab6-c56b-4fcd-a7d4-259b7504167b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:18.556307 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ef230ab6-c56b-4fcd-a7d4-259b7504167b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:18.557018 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ef230ab6-c56b-4fcd-a7d4-259b7504167b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:18.557481 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ef230ab6-c56b-4fcd-a7d4-259b7504167b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:18.557913 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ef230ab6-c56b-4fcd-a7d4-259b7504167b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:18.570831 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 236/479] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:18 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1260 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:18.589887 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-070aca3d-a5f7-4017-a138-32bab0524096 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:18.590682 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-070aca3d-a5f7-4017-a138-32bab0524096 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:18.598479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-070aca3d-a5f7-4017-a138-32bab0524096 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:18.598970 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-070aca3d-a5f7-4017-a138-32bab0524096 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:18.599407 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-070aca3d-a5f7-4017-a138-32bab0524096 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:18.600105 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-070aca3d-a5f7-4017-a138-32bab0524096 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:18.600559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-070aca3d-a5f7-4017-a138-32bab0524096 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:18.601018 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-070aca3d-a5f7-4017-a138-32bab0524096 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:18.943883 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ef230ab6-c56b-4fcd-a7d4-259b7504167b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:18.954265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ef230ab6-c56b-4fcd-a7d4-259b7504167b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:18.955963 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ef230ab6-c56b-4fcd-a7d4-259b7504167b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:18.957436 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ef230ab6-c56b-4fcd-a7d4-259b7504167b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.413600 Sep 23 14:06:18.964340 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 244/480] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:18 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:06:18.971592 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-070aca3d-a5f7-4017-a138-32bab0524096 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:18.980188 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-070aca3d-a5f7-4017-a138-32bab0524096 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.394212 Sep 23 14:06:18.980959 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 237/481] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:18 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:19.578997 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1e335155-e69f-4fb3-98ec-fdc1bfb36647 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:19.579579 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1e335155-e69f-4fb3-98ec-fdc1bfb36647 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:19.585895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1e335155-e69f-4fb3-98ec-fdc1bfb36647 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:19.586413 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1e335155-e69f-4fb3-98ec-fdc1bfb36647 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:19.586848 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1e335155-e69f-4fb3-98ec-fdc1bfb36647 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:19.587527 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1e335155-e69f-4fb3-98ec-fdc1bfb36647 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:19.587981 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1e335155-e69f-4fb3-98ec-fdc1bfb36647 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:19.588404 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1e335155-e69f-4fb3-98ec-fdc1bfb36647 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:19.801861 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1e335155-e69f-4fb3-98ec-fdc1bfb36647 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:19.810359 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1e335155-e69f-4fb3-98ec-fdc1bfb36647 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1260 microversion: 2.1 time: 0.236095 Sep 23 14:06:19.810924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 245/482] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:19 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1260 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:19.985771 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-2399c965-4a63-4478-ab98-4792e7c8a7f0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:19.986419 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-2399c965-4a63-4478-ab98-4792e7c8a7f0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:19.994501 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2399c965-4a63-4478-ab98-4792e7c8a7f0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:19.994501 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2399c965-4a63-4478-ab98-4792e7c8a7f0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:19.994501 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2399c965-4a63-4478-ab98-4792e7c8a7f0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:19.994501 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2399c965-4a63-4478-ab98-4792e7c8a7f0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:19.994857 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2399c965-4a63-4478-ab98-4792e7c8a7f0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:19.994857 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2399c965-4a63-4478-ab98-4792e7c8a7f0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:20.004468 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-202c5bf3-0b4f-4f1c-91bd-2f599fd40c07 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:20.005412 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-202c5bf3-0b4f-4f1c-91bd-2f599fd40c07 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:20.012924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-202c5bf3-0b4f-4f1c-91bd-2f599fd40c07 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:20.013447 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-202c5bf3-0b4f-4f1c-91bd-2f599fd40c07 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:20.013890 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-202c5bf3-0b4f-4f1c-91bd-2f599fd40c07 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:20.014698 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-202c5bf3-0b4f-4f1c-91bd-2f599fd40c07 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:20.015466 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-202c5bf3-0b4f-4f1c-91bd-2f599fd40c07 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:20.015900 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-202c5bf3-0b4f-4f1c-91bd-2f599fd40c07 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:20.518703 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-2399c965-4a63-4478-ab98-4792e7c8a7f0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:20.521627 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-202c5bf3-0b4f-4f1c-91bd-2f599fd40c07 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:20.533495 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-202c5bf3-0b4f-4f1c-91bd-2f599fd40c07 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.533276 Sep 23 14:06:20.550569 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 246/483] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:19 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:20.556285 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-2399c965-4a63-4478-ab98-4792e7c8a7f0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:20.558397 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-2399c965-4a63-4478-ab98-4792e7c8a7f0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:20.560561 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-2399c965-4a63-4478-ab98-4792e7c8a7f0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.579102 Sep 23 14:06:20.562014 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 238/484] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:19 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:06:20.833980 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-bd9f2190-dedb-468a-bd7e-0a45d8bfd1c7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:20.834640 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-bd9f2190-dedb-468a-bd7e-0a45d8bfd1c7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:20.841041 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bd9f2190-dedb-468a-bd7e-0a45d8bfd1c7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:20.841531 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bd9f2190-dedb-468a-bd7e-0a45d8bfd1c7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:20.841999 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bd9f2190-dedb-468a-bd7e-0a45d8bfd1c7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:20.842758 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bd9f2190-dedb-468a-bd7e-0a45d8bfd1c7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:20.843821 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bd9f2190-dedb-468a-bd7e-0a45d8bfd1c7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:20.844266 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bd9f2190-dedb-468a-bd7e-0a45d8bfd1c7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:20.862347 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=100 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:20.981694 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-bd9f2190-dedb-468a-bd7e-0a45d8bfd1c7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:20.993450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-bd9f2190-dedb-468a-bd7e-0a45d8bfd1c7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1260 microversion: 2.1 time: 0.163339 Sep 23 14:06:20.994028 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 247/485] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:20 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:21.570252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6b03391f-84a2-44e8-b7a1-c864a1242be3 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:21.570823 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6b03391f-84a2-44e8-b7a1-c864a1242be3 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:21.576547 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b03391f-84a2-44e8-b7a1-c864a1242be3 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:21.577028 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b03391f-84a2-44e8-b7a1-c864a1242be3 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:21.577519 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b03391f-84a2-44e8-b7a1-c864a1242be3 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:21.578172 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b03391f-84a2-44e8-b7a1-c864a1242be3 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:21.578652 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b03391f-84a2-44e8-b7a1-c864a1242be3 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:21.579073 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b03391f-84a2-44e8-b7a1-c864a1242be3 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:21.587456 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5ce4e43b-aec3-4239-bfc2-91de7c122462 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:21.588066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5ce4e43b-aec3-4239-bfc2-91de7c122462 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:21.593895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5ce4e43b-aec3-4239-bfc2-91de7c122462 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:21.594403 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5ce4e43b-aec3-4239-bfc2-91de7c122462 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:21.594843 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5ce4e43b-aec3-4239-bfc2-91de7c122462 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:21.595528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5ce4e43b-aec3-4239-bfc2-91de7c122462 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:21.595980 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5ce4e43b-aec3-4239-bfc2-91de7c122462 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:21.596400 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5ce4e43b-aec3-4239-bfc2-91de7c122462 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:21.596987 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=100 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:21.783097 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6b03391f-84a2-44e8-b7a1-c864a1242be3 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:21.790356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5ce4e43b-aec3-4239-bfc2-91de7c122462 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:21.790782 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6b03391f-84a2-44e8-b7a1-c864a1242be3 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.224396 Sep 23 14:06:21.791354 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 239/486] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:21 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:21.799933 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5ce4e43b-aec3-4239-bfc2-91de7c122462 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:21.801629 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5ce4e43b-aec3-4239-bfc2-91de7c122462 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:21.802800 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5ce4e43b-aec3-4239-bfc2-91de7c122462 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.219227 Sep 23 14:06:21.803347 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 248/487] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:21 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:06:22.017129 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a631c07b-660d-4b0a-934e-1bdd2eab1037 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:22.017786 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a631c07b-660d-4b0a-934e-1bdd2eab1037 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:22.026185 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a631c07b-660d-4b0a-934e-1bdd2eab1037 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:22.027204 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a631c07b-660d-4b0a-934e-1bdd2eab1037 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:22.027771 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a631c07b-660d-4b0a-934e-1bdd2eab1037 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:22.028492 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a631c07b-660d-4b0a-934e-1bdd2eab1037 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:22.029243 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a631c07b-660d-4b0a-934e-1bdd2eab1037 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:22.029800 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a631c07b-660d-4b0a-934e-1bdd2eab1037 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:22.163077 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a631c07b-660d-4b0a-934e-1bdd2eab1037 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:22.171466 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a631c07b-660d-4b0a-934e-1bdd2eab1037 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1260 microversion: 2.1 time: 0.158183 Sep 23 14:06:22.172132 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 240/488] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:22 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:22.815898 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-fb2b5f58-c6fd-497b-96b5-9489186d9cb4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:22.816513 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-fb2b5f58-c6fd-497b-96b5-9489186d9cb4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:22.823288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fb2b5f58-c6fd-497b-96b5-9489186d9cb4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:22.823779 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fb2b5f58-c6fd-497b-96b5-9489186d9cb4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:22.824217 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fb2b5f58-c6fd-497b-96b5-9489186d9cb4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:22.824905 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fb2b5f58-c6fd-497b-96b5-9489186d9cb4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:22.825850 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fb2b5f58-c6fd-497b-96b5-9489186d9cb4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:22.825850 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fb2b5f58-c6fd-497b-96b5-9489186d9cb4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:22.828156 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5a07a731-db27-4501-9450-ef2eb95f4b67 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:22.829042 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-5a07a731-db27-4501-9450-ef2eb95f4b67 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:22.835014 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5a07a731-db27-4501-9450-ef2eb95f4b67 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:22.835158 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5a07a731-db27-4501-9450-ef2eb95f4b67 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:22.835559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5a07a731-db27-4501-9450-ef2eb95f4b67 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:22.836244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5a07a731-db27-4501-9450-ef2eb95f4b67 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:22.836794 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5a07a731-db27-4501-9450-ef2eb95f4b67 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:22.837229 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5a07a731-db27-4501-9450-ef2eb95f4b67 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:23.026504 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-fb2b5f58-c6fd-497b-96b5-9489186d9cb4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:23.030625 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5a07a731-db27-4501-9450-ef2eb95f4b67 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:23.034612 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-fb2b5f58-c6fd-497b-96b5-9489186d9cb4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.222574 Sep 23 14:06:23.035988 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 249/489] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:22 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:23.040190 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5a07a731-db27-4501-9450-ef2eb95f4b67 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:23.041632 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5a07a731-db27-4501-9450-ef2eb95f4b67 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:23.043469 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5a07a731-db27-4501-9450-ef2eb95f4b67 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.219592 Sep 23 14:06:23.044178 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 241/490] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:22 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:06:23.056373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-efaee373-f4dc-448e-8eea-57a65740f8fb req-c524fff7-73fb-4b3b-9228-01c60eb1c100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97557fbe-c1f4-464e-93b8-3c71fbc48936", "name": "network-vif-plugged", "status": "completed", "tag": "0765d95c-b5b8-4eb9-aef1-96129a9a206d"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:06:23.068465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-efaee373-f4dc-448e-8eea-57a65740f8fb req-c524fff7-73fb-4b3b-9228-01c60eb1c100 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:23.068968 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-efaee373-f4dc-448e-8eea-57a65740f8fb req-c524fff7-73fb-4b3b-9228-01c60eb1c100 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:23.069392 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-efaee373-f4dc-448e-8eea-57a65740f8fb req-c524fff7-73fb-4b3b-9228-01c60eb1c100 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:23.082055 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-efaee373-f4dc-448e-8eea-57a65740f8fb req-c524fff7-73fb-4b3b-9228-01c60eb1c100 service nova] Creating event network-vif-plugged:0765d95c-b5b8-4eb9-aef1-96129a9a206d for instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 on hv-cinder-85743 Sep 23 14:06:23.087310 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-efaee373-f4dc-448e-8eea-57a65740f8fb req-c524fff7-73fb-4b3b-9228-01c60eb1c100 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035666 Sep 23 14:06:23.087905 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 250/491] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:06:23.194750 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-374d62f7-c6f7-45f4-b9e5-b9e26e12f782 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:23.195460 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-374d62f7-c6f7-45f4-b9e5-b9e26e12f782 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:23.201987 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-374d62f7-c6f7-45f4-b9e5-b9e26e12f782 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:23.203539 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-374d62f7-c6f7-45f4-b9e5-b9e26e12f782 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:23.203925 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-374d62f7-c6f7-45f4-b9e5-b9e26e12f782 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:23.204651 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-374d62f7-c6f7-45f4-b9e5-b9e26e12f782 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:23.205115 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-374d62f7-c6f7-45f4-b9e5-b9e26e12f782 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:23.205540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-374d62f7-c6f7-45f4-b9e5-b9e26e12f782 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:23.337179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-374d62f7-c6f7-45f4-b9e5-b9e26e12f782 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:23.345103 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-374d62f7-c6f7-45f4-b9e5-b9e26e12f782 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1260 microversion: 2.1 time: 0.154162 Sep 23 14:06:23.345664 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 242/492] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:23 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:24.064605 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-78f3b099-aaf4-48df-ad24-debac7cd63c1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:24.065381 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-78f3b099-aaf4-48df-ad24-debac7cd63c1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:24.070984 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-c04e3cb7-4df7-4363-b896-6e119dc41387 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:24.071844 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-78f3b099-aaf4-48df-ad24-debac7cd63c1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:24.072042 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-c04e3cb7-4df7-4363-b896-6e119dc41387 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:24.072327 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-78f3b099-aaf4-48df-ad24-debac7cd63c1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:24.072766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-78f3b099-aaf4-48df-ad24-debac7cd63c1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:24.073518 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-78f3b099-aaf4-48df-ad24-debac7cd63c1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:24.074076 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-78f3b099-aaf4-48df-ad24-debac7cd63c1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:24.074558 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-78f3b099-aaf4-48df-ad24-debac7cd63c1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:24.079801 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c04e3cb7-4df7-4363-b896-6e119dc41387 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:24.080282 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c04e3cb7-4df7-4363-b896-6e119dc41387 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:24.080720 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c04e3cb7-4df7-4363-b896-6e119dc41387 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:24.081402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c04e3cb7-4df7-4363-b896-6e119dc41387 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:24.081854 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c04e3cb7-4df7-4363-b896-6e119dc41387 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:24.082273 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c04e3cb7-4df7-4363-b896-6e119dc41387 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:24.265467 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-78f3b099-aaf4-48df-ad24-debac7cd63c1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:24.273017 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-78f3b099-aaf4-48df-ad24-debac7cd63c1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.213406 Sep 23 14:06:24.273589 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 251/493] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:24 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:24.276672 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-c04e3cb7-4df7-4363-b896-6e119dc41387 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:24.285941 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-c04e3cb7-4df7-4363-b896-6e119dc41387 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:24.287394 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-c04e3cb7-4df7-4363-b896-6e119dc41387 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:24.288535 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-c04e3cb7-4df7-4363-b896-6e119dc41387 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.222404 Sep 23 14:06:24.289075 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 243/494] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:24 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:06:24.367689 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-20780da1-0eae-4467-93d4-5407c2a82cf8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:24.368227 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-20780da1-0eae-4467-93d4-5407c2a82cf8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:24.374070 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20780da1-0eae-4467-93d4-5407c2a82cf8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:24.374935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20780da1-0eae-4467-93d4-5407c2a82cf8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:24.375633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20780da1-0eae-4467-93d4-5407c2a82cf8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:24.376786 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20780da1-0eae-4467-93d4-5407c2a82cf8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:24.377560 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20780da1-0eae-4467-93d4-5407c2a82cf8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:24.378283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20780da1-0eae-4467-93d4-5407c2a82cf8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:24.515547 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-20780da1-0eae-4467-93d4-5407c2a82cf8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:24.523293 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-20780da1-0eae-4467-93d4-5407c2a82cf8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1260 microversion: 2.1 time: 0.159432 Sep 23 14:06:24.523895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 252/495] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:24 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:25.106522 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-349286c5-355e-444e-9f8b-7dcf8d5426a1 req-39705917-da2b-467b-a52e-9059486e6ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eee99559-a86f-4088-9fd1-a6ae97245d92", "name": "network-vif-plugged", "status": "completed", "tag": "57f85532-237c-4ac3-8270-603ea7e41e29"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:06:25.116487 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-349286c5-355e-444e-9f8b-7dcf8d5426a1 req-39705917-da2b-467b-a52e-9059486e6ee2 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:25.116968 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-349286c5-355e-444e-9f8b-7dcf8d5426a1 req-39705917-da2b-467b-a52e-9059486e6ee2 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:25.126866 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-349286c5-355e-444e-9f8b-7dcf8d5426a1 req-39705917-da2b-467b-a52e-9059486e6ee2 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:25.128486 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-349286c5-355e-444e-9f8b-7dcf8d5426a1 req-39705917-da2b-467b-a52e-9059486e6ee2 service nova] Creating event network-vif-plugged:57f85532-237c-4ac3-8270-603ea7e41e29 for instance eee99559-a86f-4088-9fd1-a6ae97245d92 on hv-cinder-85743 Sep 23 14:06:25.133343 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-349286c5-355e-444e-9f8b-7dcf8d5426a1 req-39705917-da2b-467b-a52e-9059486e6ee2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030466 Sep 23 14:06:25.133909 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 244/496] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:06:25.296990 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-20066f13-a2d9-4f36-a65a-81aae27189c0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:25.297747 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-20066f13-a2d9-4f36-a65a-81aae27189c0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:25.304407 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20066f13-a2d9-4f36-a65a-81aae27189c0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:25.304917 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20066f13-a2d9-4f36-a65a-81aae27189c0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:25.305348 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20066f13-a2d9-4f36-a65a-81aae27189c0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:25.306023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20066f13-a2d9-4f36-a65a-81aae27189c0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:25.306508 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20066f13-a2d9-4f36-a65a-81aae27189c0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:25.306942 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20066f13-a2d9-4f36-a65a-81aae27189c0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:25.313969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-88ba71f5-6237-407f-be9b-cc42c78f39f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:25.314687 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-88ba71f5-6237-407f-be9b-cc42c78f39f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:25.320718 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-88ba71f5-6237-407f-be9b-cc42c78f39f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:25.321200 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-88ba71f5-6237-407f-be9b-cc42c78f39f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:25.321639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-88ba71f5-6237-407f-be9b-cc42c78f39f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:25.322346 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-88ba71f5-6237-407f-be9b-cc42c78f39f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:25.322814 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-88ba71f5-6237-407f-be9b-cc42c78f39f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:25.323231 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-88ba71f5-6237-407f-be9b-cc42c78f39f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:25.503795 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-20066f13-a2d9-4f36-a65a-81aae27189c0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:25.507565 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-88ba71f5-6237-407f-be9b-cc42c78f39f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:25.511731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-20066f13-a2d9-4f36-a65a-81aae27189c0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.219052 Sep 23 14:06:25.512379 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 253/497] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:25 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:25.517487 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-88ba71f5-6237-407f-be9b-cc42c78f39f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:25.518997 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-88ba71f5-6237-407f-be9b-cc42c78f39f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:25.520159 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-88ba71f5-6237-407f-be9b-cc42c78f39f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.211028 Sep 23 14:06:25.520740 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 245/498] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:25 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:06:25.547310 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8bf07692-0f63-4c7a-ae6a-28df78fc1dcc tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:25.548070 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-8bf07692-0f63-4c7a-ae6a-28df78fc1dcc tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:25.554092 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8bf07692-0f63-4c7a-ae6a-28df78fc1dcc tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:25.554624 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8bf07692-0f63-4c7a-ae6a-28df78fc1dcc tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:25.555056 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8bf07692-0f63-4c7a-ae6a-28df78fc1dcc tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:25.555734 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8bf07692-0f63-4c7a-ae6a-28df78fc1dcc tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:25.556184 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8bf07692-0f63-4c7a-ae6a-28df78fc1dcc tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:25.556630 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8bf07692-0f63-4c7a-ae6a-28df78fc1dcc tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:25.682747 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-8bf07692-0f63-4c7a-ae6a-28df78fc1dcc tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:25.690745 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8bf07692-0f63-4c7a-ae6a-28df78fc1dcc tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1260 microversion: 2.1 time: 0.147818 Sep 23 14:06:25.691307 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 254/499] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:25 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:26.534836 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8c595060-1436-4991-b916-b11ee4930558 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:26.535560 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8c595060-1436-4991-b916-b11ee4930558 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:26.541472 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c595060-1436-4991-b916-b11ee4930558 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:26.541947 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c595060-1436-4991-b916-b11ee4930558 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:26.542400 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c595060-1436-4991-b916-b11ee4930558 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:26.543087 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c595060-1436-4991-b916-b11ee4930558 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:26.543539 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c595060-1436-4991-b916-b11ee4930558 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:26.544002 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c595060-1436-4991-b916-b11ee4930558 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:26.545453 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-898cb5d5-710b-4d7a-b369-a83a2ade0bfa tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:26.546086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-898cb5d5-710b-4d7a-b369-a83a2ade0bfa tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:26.553460 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-898cb5d5-710b-4d7a-b369-a83a2ade0bfa tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:26.554094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-898cb5d5-710b-4d7a-b369-a83a2ade0bfa tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:26.554568 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-898cb5d5-710b-4d7a-b369-a83a2ade0bfa tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:26.555269 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-898cb5d5-710b-4d7a-b369-a83a2ade0bfa tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:26.555730 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-898cb5d5-710b-4d7a-b369-a83a2ade0bfa tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:26.556164 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-898cb5d5-710b-4d7a-b369-a83a2ade0bfa tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:26.734966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8c595060-1436-4991-b916-b11ee4930558 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:26.742985 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8c595060-1436-4991-b916-b11ee4930558 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.212490 Sep 23 14:06:26.743562 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 246/500] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:26 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:26.748829 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-898cb5d5-710b-4d7a-b369-a83a2ade0bfa tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:26.756952 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-28beebd7-0dd1-4a88-8342-23938356b04a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:26.757715 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-28beebd7-0dd1-4a88-8342-23938356b04a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:26.763016 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-898cb5d5-710b-4d7a-b369-a83a2ade0bfa tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:26.764135 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-28beebd7-0dd1-4a88-8342-23938356b04a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:26.764704 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-28beebd7-0dd1-4a88-8342-23938356b04a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:26.764807 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-898cb5d5-710b-4d7a-b369-a83a2ade0bfa tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:26.765221 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-28beebd7-0dd1-4a88-8342-23938356b04a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:26.765984 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-898cb5d5-710b-4d7a-b369-a83a2ade0bfa tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1810 microversion: 2.20 time: 0.224925 Sep 23 14:06:26.766085 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-28beebd7-0dd1-4a88-8342-23938356b04a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:26.766571 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 255/501] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:26 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1810 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:06:26.766694 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-28beebd7-0dd1-4a88-8342-23938356b04a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:26.767097 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-28beebd7-0dd1-4a88-8342-23938356b04a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:26.900527 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-28beebd7-0dd1-4a88-8342-23938356b04a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:26.908705 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-28beebd7-0dd1-4a88-8342-23938356b04a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1260 microversion: 2.1 time: 0.163951 Sep 23 14:06:26.909249 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 247/502] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:26 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:27.766950 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ca2d215b-0fff-455d-85de-3897e7ff5086 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:27.767557 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ca2d215b-0fff-455d-85de-3897e7ff5086 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:27.774276 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca2d215b-0fff-455d-85de-3897e7ff5086 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:27.774827 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca2d215b-0fff-455d-85de-3897e7ff5086 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:27.775272 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca2d215b-0fff-455d-85de-3897e7ff5086 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:27.775965 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca2d215b-0fff-455d-85de-3897e7ff5086 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:27.776424 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca2d215b-0fff-455d-85de-3897e7ff5086 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:27.776852 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca2d215b-0fff-455d-85de-3897e7ff5086 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:27.791711 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8f5ce0bd-2e6c-4019-b003-e0144cae0f31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:27.792348 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8f5ce0bd-2e6c-4019-b003-e0144cae0f31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:27.799071 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8f5ce0bd-2e6c-4019-b003-e0144cae0f31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:27.799562 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8f5ce0bd-2e6c-4019-b003-e0144cae0f31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:27.800005 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8f5ce0bd-2e6c-4019-b003-e0144cae0f31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:27.800986 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8f5ce0bd-2e6c-4019-b003-e0144cae0f31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:27.801444 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8f5ce0bd-2e6c-4019-b003-e0144cae0f31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:27.801873 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8f5ce0bd-2e6c-4019-b003-e0144cae0f31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:27.968745 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ca2d215b-0fff-455d-85de-3897e7ff5086 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:27.976472 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ca2d215b-0fff-455d-85de-3897e7ff5086 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1366 microversion: 2.1 time: 0.213941 Sep 23 14:06:27.977042 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 256/503] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:27 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:27.981445 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-22ed0d30-ecf7-4b2d-9aa5-5af83eca7fc2 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:27.982050 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-22ed0d30-ecf7-4b2d-9aa5-5af83eca7fc2 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:27.986303 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8f5ce0bd-2e6c-4019-b003-e0144cae0f31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:27.987760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-22ed0d30-ecf7-4b2d-9aa5-5af83eca7fc2 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:27.988247 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-22ed0d30-ecf7-4b2d-9aa5-5af83eca7fc2 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:27.988871 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-22ed0d30-ecf7-4b2d-9aa5-5af83eca7fc2 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:27.989634 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-22ed0d30-ecf7-4b2d-9aa5-5af83eca7fc2 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:27.990689 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-22ed0d30-ecf7-4b2d-9aa5-5af83eca7fc2 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:27.991122 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-22ed0d30-ecf7-4b2d-9aa5-5af83eca7fc2 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:27.995229 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8f5ce0bd-2e6c-4019-b003-e0144cae0f31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:27.996685 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8f5ce0bd-2e6c-4019-b003-e0144cae0f31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:27.997840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8f5ce0bd-2e6c-4019-b003-e0144cae0f31 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1797 microversion: 2.20 time: 0.210121 Sep 23 14:06:27.998418 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 248/504] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:06:27 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1797 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:06:28.127244 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-22ed0d30-ecf7-4b2d-9aa5-5af83eca7fc2 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:28.133058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-22ed0d30-ecf7-4b2d-9aa5-5af83eca7fc2 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1260 microversion: 2.1 time: 0.155013 Sep 23 14:06:28.133641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 257/505] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:27 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:29.000105 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-c98af3cc-8abe-4834-96b7-b29694d33549 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:29.000901 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-c98af3cc-8abe-4834-96b7-b29694d33549 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:29.007141 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c98af3cc-8abe-4834-96b7-b29694d33549 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:29.007624 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c98af3cc-8abe-4834-96b7-b29694d33549 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:29.008056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c98af3cc-8abe-4834-96b7-b29694d33549 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:29.008744 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c98af3cc-8abe-4834-96b7-b29694d33549 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:29.009193 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c98af3cc-8abe-4834-96b7-b29694d33549 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:29.009612 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c98af3cc-8abe-4834-96b7-b29694d33549 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:29.144213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-c98af3cc-8abe-4834-96b7-b29694d33549 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:29.152133 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-c98af3cc-8abe-4834-96b7-b29694d33549 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1556 microversion: 2.1 time: 0.156624 Sep 23 14:06:29.152683 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 249/506] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:28 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:29.154914 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-992cf4ed-06d5-4e78-96e5-0672f611930f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:29.155609 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-992cf4ed-06d5-4e78-96e5-0672f611930f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:29.162869 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-992cf4ed-06d5-4e78-96e5-0672f611930f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:29.163356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-992cf4ed-06d5-4e78-96e5-0672f611930f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:29.163793 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-992cf4ed-06d5-4e78-96e5-0672f611930f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:29.164486 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-992cf4ed-06d5-4e78-96e5-0672f611930f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:29.164954 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-992cf4ed-06d5-4e78-96e5-0672f611930f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:29.165423 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-992cf4ed-06d5-4e78-96e5-0672f611930f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:29.174503 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b6cd9bf9-4eb5-461f-bac1-549c495d931a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:29.174993 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b6cd9bf9-4eb5-461f-bac1-549c495d931a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:29.180994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b6cd9bf9-4eb5-461f-bac1-549c495d931a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:29.181476 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b6cd9bf9-4eb5-461f-bac1-549c495d931a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:29.181909 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b6cd9bf9-4eb5-461f-bac1-549c495d931a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:29.182610 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b6cd9bf9-4eb5-461f-bac1-549c495d931a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:29.183062 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b6cd9bf9-4eb5-461f-bac1-549c495d931a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:29.183487 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b6cd9bf9-4eb5-461f-bac1-549c495d931a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:29.294406 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b6cd9bf9-4eb5-461f-bac1-549c495d931a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123602 Sep 23 14:06:29.294992 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 250/507] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 23 14:06:29 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:06:29.333341 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-992cf4ed-06d5-4e78-96e5-0672f611930f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:29.341250 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-992cf4ed-06d5-4e78-96e5-0672f611930f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1260 microversion: 2.1 time: 0.190273 Sep 23 14:06:29.341744 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 258/508] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:29 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:30.364376 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ca5b3510-3cdb-4a00-a11c-d3882e17939d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:30.364992 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ca5b3510-3cdb-4a00-a11c-d3882e17939d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:30.371979 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ca5b3510-3cdb-4a00-a11c-d3882e17939d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:30.372732 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ca5b3510-3cdb-4a00-a11c-d3882e17939d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:30.373183 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ca5b3510-3cdb-4a00-a11c-d3882e17939d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:30.373895 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ca5b3510-3cdb-4a00-a11c-d3882e17939d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:30.374374 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ca5b3510-3cdb-4a00-a11c-d3882e17939d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:30.374865 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ca5b3510-3cdb-4a00-a11c-d3882e17939d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:30.516758 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-07ca9e4f-ff30-4115-8096-2e7db1cecc17 req-08b309bb-047a-448e-9323-18e96a41765e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3cf38f-b2d0-465c-9f91-7b04e669be1a", "name": "network-vif-plugged", "status": "completed", "tag": "ddb61f77-2e1f-4d02-bd20-42e3ca25c62d"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:06:30.528974 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-07ca9e4f-ff30-4115-8096-2e7db1cecc17 req-08b309bb-047a-448e-9323-18e96a41765e service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:30.529702 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-07ca9e4f-ff30-4115-8096-2e7db1cecc17 req-08b309bb-047a-448e-9323-18e96a41765e service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:30.530304 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-07ca9e4f-ff30-4115-8096-2e7db1cecc17 req-08b309bb-047a-448e-9323-18e96a41765e service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:30.535426 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ca5b3510-3cdb-4a00-a11c-d3882e17939d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:30.542558 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-07ca9e4f-ff30-4115-8096-2e7db1cecc17 req-08b309bb-047a-448e-9323-18e96a41765e service nova] Creating event network-vif-plugged:ddb61f77-2e1f-4d02-bd20-42e3ca25c62d for instance ae3cf38f-b2d0-465c-9f91-7b04e669be1a on hv-cinder-85743 Sep 23 14:06:30.544227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ca5b3510-3cdb-4a00-a11c-d3882e17939d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1260 microversion: 2.1 time: 0.183998 Sep 23 14:06:30.550371 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 251/509] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:30 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:30.550556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-07ca9e4f-ff30-4115-8096-2e7db1cecc17 req-08b309bb-047a-448e-9323-18e96a41765e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037572 Sep 23 14:06:30.552053 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-f7bfba1b-2e24-4e4f-bb06-5a8efc2d1417 req-11859bbd-1ebf-4039-8e48-546e469de404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eee99559-a86f-4088-9fd1-a6ae97245d92", "tag": "57f85532-237c-4ac3-8270-603ea7e41e29"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:06:30.554563 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 259/510] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:06:30.562905 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f7bfba1b-2e24-4e4f-bb06-5a8efc2d1417 req-11859bbd-1ebf-4039-8e48-546e469de404 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:30.563396 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f7bfba1b-2e24-4e4f-bb06-5a8efc2d1417 req-11859bbd-1ebf-4039-8e48-546e469de404 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:30.563896 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f7bfba1b-2e24-4e4f-bb06-5a8efc2d1417 req-11859bbd-1ebf-4039-8e48-546e469de404 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:30.575190 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-f7bfba1b-2e24-4e4f-bb06-5a8efc2d1417 req-11859bbd-1ebf-4039-8e48-546e469de404 service nova] Creating event network-changed:57f85532-237c-4ac3-8270-603ea7e41e29 for instance eee99559-a86f-4088-9fd1-a6ae97245d92 on hv-cinder-85743 Sep 23 14:06:30.580443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-f7bfba1b-2e24-4e4f-bb06-5a8efc2d1417 req-11859bbd-1ebf-4039-8e48-546e469de404 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033319 Sep 23 14:06:30.581104 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 252/511] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:06:31.572644 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-40e2275d-47c4-4257-9ec5-4e9d96532adb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:31.573456 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-40e2275d-47c4-4257-9ec5-4e9d96532adb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:31.580185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-40e2275d-47c4-4257-9ec5-4e9d96532adb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:31.580739 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-40e2275d-47c4-4257-9ec5-4e9d96532adb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:31.581243 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-40e2275d-47c4-4257-9ec5-4e9d96532adb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:31.582007 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-40e2275d-47c4-4257-9ec5-4e9d96532adb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:31.582507 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-40e2275d-47c4-4257-9ec5-4e9d96532adb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:31.582929 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-40e2275d-47c4-4257-9ec5-4e9d96532adb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:31.721490 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-40e2275d-47c4-4257-9ec5-4e9d96532adb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:31.728371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-40e2275d-47c4-4257-9ec5-4e9d96532adb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1260 microversion: 2.1 time: 0.160238 Sep 23 14:06:31.738417 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 260/512] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:31 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:32.753834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-54765753-7c81-479d-8035-4679e252e6c3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:32.754573 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-54765753-7c81-479d-8035-4679e252e6c3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:32.760638 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54765753-7c81-479d-8035-4679e252e6c3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:32.761120 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54765753-7c81-479d-8035-4679e252e6c3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:32.761554 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54765753-7c81-479d-8035-4679e252e6c3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:32.762238 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54765753-7c81-479d-8035-4679e252e6c3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:32.763460 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54765753-7c81-479d-8035-4679e252e6c3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:32.764068 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54765753-7c81-479d-8035-4679e252e6c3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:32.902102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-54765753-7c81-479d-8035-4679e252e6c3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:32.910346 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-54765753-7c81-479d-8035-4679e252e6c3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1444 microversion: 2.1 time: 0.161942 Sep 23 14:06:32.910903 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 253/513] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:32 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:32.933802 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3e5cd25a-97ca-4799-a5e8-60b04d47746b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:32.934456 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3e5cd25a-97ca-4799-a5e8-60b04d47746b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:32.940963 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e5cd25a-97ca-4799-a5e8-60b04d47746b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:32.941444 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e5cd25a-97ca-4799-a5e8-60b04d47746b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:32.941874 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e5cd25a-97ca-4799-a5e8-60b04d47746b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:32.942581 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e5cd25a-97ca-4799-a5e8-60b04d47746b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:32.943035 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e5cd25a-97ca-4799-a5e8-60b04d47746b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:32.943457 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e5cd25a-97ca-4799-a5e8-60b04d47746b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:33.072444 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3e5cd25a-97ca-4799-a5e8-60b04d47746b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:33.080337 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3e5cd25a-97ca-4799-a5e8-60b04d47746b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1444 microversion: 2.1 time: 0.150443 Sep 23 14:06:33.080902 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 261/514] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:32 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:34.957998 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-f57ad8af-bede-469d-a357-9251d3ab7674 req-6c673aa5-1d95-406c-83ad-07508c7eea9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3cf38f-b2d0-465c-9f91-7b04e669be1a", "tag": "ddb61f77-2e1f-4d02-bd20-42e3ca25c62d"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:06:34.971500 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f57ad8af-bede-469d-a357-9251d3ab7674 req-6c673aa5-1d95-406c-83ad-07508c7eea9c service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:34.971500 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f57ad8af-bede-469d-a357-9251d3ab7674 req-6c673aa5-1d95-406c-83ad-07508c7eea9c service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:34.971500 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f57ad8af-bede-469d-a357-9251d3ab7674 req-6c673aa5-1d95-406c-83ad-07508c7eea9c service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:34.980366 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-f57ad8af-bede-469d-a357-9251d3ab7674 req-6c673aa5-1d95-406c-83ad-07508c7eea9c service nova] Creating event network-changed:ddb61f77-2e1f-4d02-bd20-42e3ca25c62d for instance ae3cf38f-b2d0-465c-9f91-7b04e669be1a on hv-cinder-85743 Sep 23 14:06:34.986021 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-f57ad8af-bede-469d-a357-9251d3ab7674 req-6c673aa5-1d95-406c-83ad-07508c7eea9c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032713 Sep 23 14:06:34.986658 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 254/515] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:06:52.806757 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-03ec6f08-9640-411c-b0e4-6d50b7c3abcd tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:52.807353 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-03ec6f08-9640-411c-b0e4-6d50b7c3abcd tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:52.809483 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=73 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:52.810151 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=78 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:52.814852 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03ec6f08-9640-411c-b0e4-6d50b7c3abcd tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:52.815340 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03ec6f08-9640-411c-b0e4-6d50b7c3abcd tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:52.815807 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03ec6f08-9640-411c-b0e4-6d50b7c3abcd tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:52.816495 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03ec6f08-9640-411c-b0e4-6d50b7c3abcd tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:52.816990 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03ec6f08-9640-411c-b0e4-6d50b7c3abcd tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:52.818191 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03ec6f08-9640-411c-b0e4-6d50b7c3abcd tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:52.842395 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-03ec6f08-9640-411c-b0e4-6d50b7c3abcd tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Going to try to terminate instance {{(pid=121073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:06:53.080734 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-03ec6f08-9640-411c-b0e4-6d50b7c3abcd tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "DELETE /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 204 len: 0 microversion: 2.1 time: 0.278610 Sep 23 14:06:53.081261 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 262/516] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:06:52 2022] DELETE /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:06:53.090410 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=80 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:53.091206 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=78 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:53.095244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-43df28b9-9559-4ce2-b8f5-43c95b59bbe7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:53.095940 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-43df28b9-9559-4ce2-b8f5-43c95b59bbe7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:53.102729 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43df28b9-9559-4ce2-b8f5-43c95b59bbe7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:53.103217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43df28b9-9559-4ce2-b8f5-43c95b59bbe7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:53.103653 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43df28b9-9559-4ce2-b8f5-43c95b59bbe7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:53.104344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43df28b9-9559-4ce2-b8f5-43c95b59bbe7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:53.104797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43df28b9-9559-4ce2-b8f5-43c95b59bbe7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:53.105219 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43df28b9-9559-4ce2-b8f5-43c95b59bbe7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:53.241519 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-43df28b9-9559-4ce2-b8f5-43c95b59bbe7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:53.249456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-43df28b9-9559-4ce2-b8f5-43c95b59bbe7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1576 microversion: 2.1 time: 0.160296 Sep 23 14:06:53.250038 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 255/517] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:53 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:54.273265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a6edb01e-1d83-4afc-b4ab-4da7d4059747 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:54.273964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a6edb01e-1d83-4afc-b4ab-4da7d4059747 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:54.280516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6edb01e-1d83-4afc-b4ab-4da7d4059747 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:54.280997 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6edb01e-1d83-4afc-b4ab-4da7d4059747 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:54.281452 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6edb01e-1d83-4afc-b4ab-4da7d4059747 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:54.282285 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6edb01e-1d83-4afc-b4ab-4da7d4059747 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:54.282827 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6edb01e-1d83-4afc-b4ab-4da7d4059747 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:54.283295 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6edb01e-1d83-4afc-b4ab-4da7d4059747 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:54.412831 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a6edb01e-1d83-4afc-b4ab-4da7d4059747 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:54.420495 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a6edb01e-1d83-4afc-b4ab-4da7d4059747 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1576 microversion: 2.1 time: 0.151638 Sep 23 14:06:54.421086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 263/518] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:54 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:54.672497 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ced1eb76-8ad7-4c40-b87c-c6ee72b076bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:54.673029 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ced1eb76-8ad7-4c40-b87c-c6ee72b076bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:54.679483 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ced1eb76-8ad7-4c40-b87c-c6ee72b076bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:54.679967 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ced1eb76-8ad7-4c40-b87c-c6ee72b076bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:54.680406 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ced1eb76-8ad7-4c40-b87c-c6ee72b076bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:54.681091 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ced1eb76-8ad7-4c40-b87c-c6ee72b076bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:54.681548 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ced1eb76-8ad7-4c40-b87c-c6ee72b076bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:54.681970 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ced1eb76-8ad7-4c40-b87c-c6ee72b076bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:54.805585 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-ced1eb76-8ad7-4c40-b87c-c6ee72b076bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lazy-loading 'services' on Instance uuid 6891295c-5fe6-44a7-adf2-f1fb03036261 {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:06:55.092133 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ced1eb76-8ad7-4c40-b87c-c6ee72b076bd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-volume_attachments/d5cd9758-d1cd-44b9-a39b-2115a07e981a" status: 202 len: 0 microversion: 2.1 time: 0.423351 Sep 23 14:06:55.092734 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 256/519] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 23 14:06:54 2022] DELETE /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-volume_attachments/d5cd9758-d1cd-44b9-a39b-2115a07e981a => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:06:55.101561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-44365a0f-a10e-460f-adf6-d320fb731862 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:55.103773 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-44365a0f-a10e-460f-adf6-d320fb731862 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:55.109670 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-44365a0f-a10e-460f-adf6-d320fb731862 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:55.110267 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-44365a0f-a10e-460f-adf6-d320fb731862 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:55.110657 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-44365a0f-a10e-460f-adf6-d320fb731862 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:55.111338 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-44365a0f-a10e-460f-adf6-d320fb731862 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:55.111793 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-44365a0f-a10e-460f-adf6-d320fb731862 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:55.112216 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-44365a0f-a10e-460f-adf6-d320fb731862 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:55.141031 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-44365a0f-a10e-460f-adf6-d320fb731862 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043893 Sep 23 14:06:55.141508 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 264/520] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:06:55 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:06:55.446197 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1d3f196a-9be4-4e7b-919b-69c4fb6ad316 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:55.447056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1d3f196a-9be4-4e7b-919b-69c4fb6ad316 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:55.453577 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1d3f196a-9be4-4e7b-919b-69c4fb6ad316 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:55.454147 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1d3f196a-9be4-4e7b-919b-69c4fb6ad316 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:55.454721 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1d3f196a-9be4-4e7b-919b-69c4fb6ad316 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:55.455427 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1d3f196a-9be4-4e7b-919b-69c4fb6ad316 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:55.455895 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1d3f196a-9be4-4e7b-919b-69c4fb6ad316 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:55.456327 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1d3f196a-9be4-4e7b-919b-69c4fb6ad316 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:55.683430 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-1d3f196a-9be4-4e7b-919b-69c4fb6ad316 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:55.691446 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1d3f196a-9be4-4e7b-919b-69c4fb6ad316 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1576 microversion: 2.1 time: 0.250854 Sep 23 14:06:55.692233 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 257/521] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:55 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1576 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:56.154354 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-7a9b1dcc-e28e-469b-abc4-f33683d952ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:56.156677 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-7a9b1dcc-e28e-469b-abc4-f33683d952ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:56.163207 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7a9b1dcc-e28e-469b-abc4-f33683d952ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:56.166566 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7a9b1dcc-e28e-469b-abc4-f33683d952ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:56.166566 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7a9b1dcc-e28e-469b-abc4-f33683d952ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:56.166566 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7a9b1dcc-e28e-469b-abc4-f33683d952ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:56.166566 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7a9b1dcc-e28e-469b-abc4-f33683d952ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:56.166961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7a9b1dcc-e28e-469b-abc4-f33683d952ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:56.196508 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-7a9b1dcc-e28e-469b-abc4-f33683d952ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046003 Sep 23 14:06:56.197400 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 265/522] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:06:56 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:06:56.333289 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-0f3097a2-eb82-4acb-a11e-365944f9d3e8 req-fac6f651-000b-4c3b-bf06-262facab2f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a131c7-2478-421b-86df-633cca15c7b7", "name": "network-vif-deleted", "tag": "894a169a-68e6-48c8-88fa-1d068254a466"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:06:56.343032 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-0f3097a2-eb82-4acb-a11e-365944f9d3e8 req-fac6f651-000b-4c3b-bf06-262facab2f4b service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:56.343507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-0f3097a2-eb82-4acb-a11e-365944f9d3e8 req-fac6f651-000b-4c3b-bf06-262facab2f4b service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:56.343936 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-0f3097a2-eb82-4acb-a11e-365944f9d3e8 req-fac6f651-000b-4c3b-bf06-262facab2f4b service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:56.354728 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-0f3097a2-eb82-4acb-a11e-365944f9d3e8 req-fac6f651-000b-4c3b-bf06-262facab2f4b service nova] Creating event network-vif-deleted:894a169a-68e6-48c8-88fa-1d068254a466 for instance 51a131c7-2478-421b-86df-633cca15c7b7 on hv-cinder-85743 Sep 23 14:06:56.359611 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-0f3097a2-eb82-4acb-a11e-365944f9d3e8 req-fac6f651-000b-4c3b-bf06-262facab2f4b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029909 Sep 23 14:06:56.360291 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 258/523] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:06:56.716157 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-640a1881-f0e0-4155-b125-289f3ffb5a4b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:56.716795 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-640a1881-f0e0-4155-b125-289f3ffb5a4b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:56.723253 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-640a1881-f0e0-4155-b125-289f3ffb5a4b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:56.723779 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-640a1881-f0e0-4155-b125-289f3ffb5a4b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:56.724220 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-640a1881-f0e0-4155-b125-289f3ffb5a4b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:56.724925 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-640a1881-f0e0-4155-b125-289f3ffb5a4b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:56.725406 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-640a1881-f0e0-4155-b125-289f3ffb5a4b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:56.725827 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-640a1881-f0e0-4155-b125-289f3ffb5a4b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:56.795406 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-640a1881-f0e0-4155-b125-289f3ffb5a4b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:56.804320 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-640a1881-f0e0-4155-b125-289f3ffb5a4b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1224 microversion: 2.1 time: 0.091394 Sep 23 14:06:56.804906 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 266/524] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:56 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:57.211188 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6a9a890f-2bef-4482-ba09-d5cd908ce4db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:57.214602 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6a9a890f-2bef-4482-ba09-d5cd908ce4db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:57.221833 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6a9a890f-2bef-4482-ba09-d5cd908ce4db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:57.222537 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6a9a890f-2bef-4482-ba09-d5cd908ce4db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:57.223047 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6a9a890f-2bef-4482-ba09-d5cd908ce4db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:57.223819 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6a9a890f-2bef-4482-ba09-d5cd908ce4db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:57.224350 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6a9a890f-2bef-4482-ba09-d5cd908ce4db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:57.225013 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6a9a890f-2bef-4482-ba09-d5cd908ce4db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:57.259161 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6a9a890f-2bef-4482-ba09-d5cd908ce4db tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053298 Sep 23 14:06:57.259738 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 259/525] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:06:57 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 14:06:57.346802 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-2f481588-8e2d-4111-bc91-0fb2f9c2745a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:57.347581 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-2f481588-8e2d-4111-bc91-0fb2f9c2745a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:57.354016 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2f481588-8e2d-4111-bc91-0fb2f9c2745a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:57.354540 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2f481588-8e2d-4111-bc91-0fb2f9c2745a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:57.354974 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2f481588-8e2d-4111-bc91-0fb2f9c2745a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:57.355664 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2f481588-8e2d-4111-bc91-0fb2f9c2745a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:57.356123 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2f481588-8e2d-4111-bc91-0fb2f9c2745a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:57.356606 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2f481588-8e2d-4111-bc91-0fb2f9c2745a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:57.386620 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-2f481588-8e2d-4111-bc91-0fb2f9c2745a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Going to try to terminate instance {{(pid=121073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:06:57.703983 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-2f481588-8e2d-4111-bc91-0fb2f9c2745a tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 204 len: 0 microversion: 2.1 time: 0.362922 Sep 23 14:06:57.704771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 267/526] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:06:57 2022] DELETE /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 14:06:57.712985 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8fe8d803-9860-4c38-82b8-a8c08ee3b3f3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:57.716215 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8fe8d803-9860-4c38-82b8-a8c08ee3b3f3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:57.720031 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8fe8d803-9860-4c38-82b8-a8c08ee3b3f3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:57.720597 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8fe8d803-9860-4c38-82b8-a8c08ee3b3f3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:57.721094 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8fe8d803-9860-4c38-82b8-a8c08ee3b3f3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:57.721989 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8fe8d803-9860-4c38-82b8-a8c08ee3b3f3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:57.722471 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8fe8d803-9860-4c38-82b8-a8c08ee3b3f3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:57.722897 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8fe8d803-9860-4c38-82b8-a8c08ee3b3f3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:57.828928 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-dacb1ae9-a1f2-4505-b046-cce31889481a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:57.830788 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-dacb1ae9-a1f2-4505-b046-cce31889481a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:57.835697 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dacb1ae9-a1f2-4505-b046-cce31889481a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:57.836277 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dacb1ae9-a1f2-4505-b046-cce31889481a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:57.836668 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dacb1ae9-a1f2-4505-b046-cce31889481a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:57.837399 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dacb1ae9-a1f2-4505-b046-cce31889481a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:57.837857 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dacb1ae9-a1f2-4505-b046-cce31889481a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:57.838284 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dacb1ae9-a1f2-4505-b046-cce31889481a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:57.852416 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8fe8d803-9860-4c38-82b8-a8c08ee3b3f3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:57.860644 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8fe8d803-9860-4c38-82b8-a8c08ee3b3f3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1690 microversion: 2.1 time: 0.151879 Sep 23 14:06:57.861222 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 260/527] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:57 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:57.874485 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dacb1ae9-a1f2-4505-b046-cce31889481a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:57.876644 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dacb1ae9-a1f2-4505-b046-cce31889481a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:57.876644 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dacb1ae9-a1f2-4505-b046-cce31889481a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:57.876644 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-dacb1ae9-a1f2-4505-b046-cce31889481a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lazy-loading 'fault' on Instance uuid 51a131c7-2478-421b-86df-633cca15c7b7 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:06:57.919064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-dacb1ae9-a1f2-4505-b046-cce31889481a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:57.926932 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-dacb1ae9-a1f2-4505-b046-cce31889481a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1229 microversion: 2.1 time: 0.102868 Sep 23 14:06:57.927502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 268/528] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:57 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:06:58.885992 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0f4d28ce-79b1-4953-a393-af6eb5cc39e8 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:58.886655 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-0f4d28ce-79b1-4953-a393-af6eb5cc39e8 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:58.892686 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f4d28ce-79b1-4953-a393-af6eb5cc39e8 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:58.893175 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f4d28ce-79b1-4953-a393-af6eb5cc39e8 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:58.893616 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f4d28ce-79b1-4953-a393-af6eb5cc39e8 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:58.894302 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f4d28ce-79b1-4953-a393-af6eb5cc39e8 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:58.894787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f4d28ce-79b1-4953-a393-af6eb5cc39e8 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:58.895216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f4d28ce-79b1-4953-a393-af6eb5cc39e8 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:58.949545 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-85a9f39f-58e6-4cd9-8674-468f83a5bd00 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:06:58.950281 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-85a9f39f-58e6-4cd9-8674-468f83a5bd00 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:06:58.956855 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85a9f39f-58e6-4cd9-8674-468f83a5bd00 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:58.957417 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85a9f39f-58e6-4cd9-8674-468f83a5bd00 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:58.957853 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85a9f39f-58e6-4cd9-8674-468f83a5bd00 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:58.958578 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85a9f39f-58e6-4cd9-8674-468f83a5bd00 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:58.959166 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85a9f39f-58e6-4cd9-8674-468f83a5bd00 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:58.959754 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85a9f39f-58e6-4cd9-8674-468f83a5bd00 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:58.990458 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85a9f39f-58e6-4cd9-8674-468f83a5bd00 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:06:58.991703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85a9f39f-58e6-4cd9-8674-468f83a5bd00 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:06:58.992152 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85a9f39f-58e6-4cd9-8674-468f83a5bd00 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:06:58.992594 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-85a9f39f-58e6-4cd9-8674-468f83a5bd00 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lazy-loading 'fault' on Instance uuid 51a131c7-2478-421b-86df-633cca15c7b7 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:06:59.045005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-85a9f39f-58e6-4cd9-8674-468f83a5bd00 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:59.048521 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-0f4d28ce-79b1-4953-a393-af6eb5cc39e8 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:06:59.052991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-85a9f39f-58e6-4cd9-8674-468f83a5bd00 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1229 microversion: 2.1 time: 0.107011 Sep 23 14:06:59.054392 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 269/529] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:58 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1229 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:06:59.060934 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-0f4d28ce-79b1-4953-a393-af6eb5cc39e8 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1690 microversion: 2.1 time: 0.179635 Sep 23 14:06:59.061631 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 261/530] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:06:58 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:00.076303 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-699effdc-0a1f-46a2-8eb7-0e0017d5b879 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:00.077069 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-699effdc-0a1f-46a2-8eb7-0e0017d5b879 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:00.083406 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-40213d3a-74a2-49a3-b934-00705834d9b0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:00.083888 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-699effdc-0a1f-46a2-8eb7-0e0017d5b879 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:00.084025 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-40213d3a-74a2-49a3-b934-00705834d9b0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:00.084134 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-699effdc-0a1f-46a2-8eb7-0e0017d5b879 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:00.084520 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-699effdc-0a1f-46a2-8eb7-0e0017d5b879 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:00.085880 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-699effdc-0a1f-46a2-8eb7-0e0017d5b879 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:00.086349 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-699effdc-0a1f-46a2-8eb7-0e0017d5b879 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:00.086777 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-699effdc-0a1f-46a2-8eb7-0e0017d5b879 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:00.090694 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-40213d3a-74a2-49a3-b934-00705834d9b0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:00.091184 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-40213d3a-74a2-49a3-b934-00705834d9b0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:00.091644 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-40213d3a-74a2-49a3-b934-00705834d9b0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:00.092318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-40213d3a-74a2-49a3-b934-00705834d9b0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:00.092776 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-40213d3a-74a2-49a3-b934-00705834d9b0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:00.093203 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-40213d3a-74a2-49a3-b934-00705834d9b0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:00.117194 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-699effdc-0a1f-46a2-8eb7-0e0017d5b879 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:00.117706 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-699effdc-0a1f-46a2-8eb7-0e0017d5b879 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:00.118142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-699effdc-0a1f-46a2-8eb7-0e0017d5b879 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:00.118610 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-699effdc-0a1f-46a2-8eb7-0e0017d5b879 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lazy-loading 'fault' on Instance uuid 51a131c7-2478-421b-86df-633cca15c7b7 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:07:00.180664 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-699effdc-0a1f-46a2-8eb7-0e0017d5b879 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:00.188318 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-699effdc-0a1f-46a2-8eb7-0e0017d5b879 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1229 microversion: 2.1 time: 0.115921 Sep 23 14:07:00.188883 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 270/531] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:00 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1229 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:00.247567 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-40213d3a-74a2-49a3-b934-00705834d9b0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:00.255265 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-40213d3a-74a2-49a3-b934-00705834d9b0 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1690 microversion: 2.1 time: 0.175789 Sep 23 14:07:00.255836 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 262/532] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:00 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:01.211703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f96b8f69-973c-4dd2-8a0f-86afd958d0f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:01.212311 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f96b8f69-973c-4dd2-8a0f-86afd958d0f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:01.218818 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f96b8f69-973c-4dd2-8a0f-86afd958d0f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:01.219302 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f96b8f69-973c-4dd2-8a0f-86afd958d0f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:01.219736 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f96b8f69-973c-4dd2-8a0f-86afd958d0f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:01.220423 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f96b8f69-973c-4dd2-8a0f-86afd958d0f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:01.220877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f96b8f69-973c-4dd2-8a0f-86afd958d0f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:01.221303 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f96b8f69-973c-4dd2-8a0f-86afd958d0f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:01.251240 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f96b8f69-973c-4dd2-8a0f-86afd958d0f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:01.251717 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f96b8f69-973c-4dd2-8a0f-86afd958d0f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:01.252156 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f96b8f69-973c-4dd2-8a0f-86afd958d0f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:01.252622 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-f96b8f69-973c-4dd2-8a0f-86afd958d0f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lazy-loading 'fault' on Instance uuid 51a131c7-2478-421b-86df-633cca15c7b7 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:07:01.279492 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a07a4e6e-39c1-46e6-8cf6-291ebe33e325 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:01.280183 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a07a4e6e-39c1-46e6-8cf6-291ebe33e325 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:01.286193 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a07a4e6e-39c1-46e6-8cf6-291ebe33e325 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:01.286773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a07a4e6e-39c1-46e6-8cf6-291ebe33e325 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:01.287270 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a07a4e6e-39c1-46e6-8cf6-291ebe33e325 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:01.288022 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a07a4e6e-39c1-46e6-8cf6-291ebe33e325 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:01.288560 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a07a4e6e-39c1-46e6-8cf6-291ebe33e325 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:01.289191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a07a4e6e-39c1-46e6-8cf6-291ebe33e325 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:01.292644 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f96b8f69-973c-4dd2-8a0f-86afd958d0f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:01.300291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f96b8f69-973c-4dd2-8a0f-86afd958d0f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 200 len: 1229 microversion: 2.1 time: 0.092981 Sep 23 14:07:01.300863 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 271/533] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:01 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:01.418461 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a07a4e6e-39c1-46e6-8cf6-291ebe33e325 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:01.426077 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a07a4e6e-39c1-46e6-8cf6-291ebe33e325 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1690 microversion: 2.1 time: 0.150572 Sep 23 14:07:01.426687 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 263/534] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:01 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:02.324033 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9223d85c-56e4-4e37-bdb2-87ed6bfe3592 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:02.324829 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9223d85c-56e4-4e37-bdb2-87ed6bfe3592 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:02.331373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9223d85c-56e4-4e37-bdb2-87ed6bfe3592 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:02.335723 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9223d85c-56e4-4e37-bdb2-87ed6bfe3592 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:02.335723 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9223d85c-56e4-4e37-bdb2-87ed6bfe3592 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:02.335723 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9223d85c-56e4-4e37-bdb2-87ed6bfe3592 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:02.335723 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9223d85c-56e4-4e37-bdb2-87ed6bfe3592 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:02.336165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9223d85c-56e4-4e37-bdb2-87ed6bfe3592 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:02.347888 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-9223d85c-56e4-4e37-bdb2-87ed6bfe3592 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] HTTP exception thrown: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9223d85c-56e4-4e37-bdb2-87ed6bfe3592 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Request method failure captured: Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 HTTP/1.1 Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbysgeiJELVNJkMP-rxGu0ZADMYw6JuJG6drZTHfEcJElUYB8PwvreI5QH2yLVVsKpCjdnd64aImupgzgoWlReOUhEXFZN0q_DAvlK5HamoXpjdLqxBvy5aL5XVRaw9njVXh9ApVlbm041NjQxtuFRdZRYihWYNAi1QEN0_20rIaHkU Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 901178273d85449e9cdaa5de235fb3e9 Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-TestVolumeBootPattern-679432431 Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:07:02.349637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:07:02.351248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_901178273d85449e9cdaa5de235fb3e9"}]}] Sep 23 14:07:02.351248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-TestVolumeBootPattern-679432431 Sep 23 14:07:02.351248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 901178273d85449e9cdaa5de235fb3e9 Sep 23 14:07:02.351248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-TestVolumeBootPattern-679432431 Sep 23 14:07:02.351248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-TestVolumeBootPattern-679432431-project Sep 23 14:07:02.351248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:07:02.351248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:07:02.351248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 9359e90c4861470d9cc060abb9c3b203 Sep 23 14:07:02.351248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-TestVolumeBootPattern-679432431-project Sep 23 14:07:02.351248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:07:02.351248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:07:02.351248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '51a131c7-2478-421b-86df-633cca15c7b7'} Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:07:02.352119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:07:02.353792 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:02.354917 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9223d85c-56e4-4e37-bdb2-87ed6bfe3592 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Returning 404 to user: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:07:02.354917 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9223d85c-56e4-4e37-bdb2-87ed6bfe3592 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 404 len: 111 microversion: 2.1 time: 0.031574 Sep 23 14:07:02.354917 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 272/535] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:02 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:07:02.450323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8c2a10c9-0118-4dce-8ce9-60f5f7c3798b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:02.451049 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8c2a10c9-0118-4dce-8ce9-60f5f7c3798b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:02.451288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1558409924", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1637587475", "security_groups": [{"name": "tempest-secgroup-smoke-195226751"}], "block_device_mapping_v2": [{"uuid": "6b5db45c-f08b-4d06-a01b-76d5c5896531", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "85b65927-108e-4662-8841-432429780256"}]}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:02.467302 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c2a10c9-0118-4dce-8ce9-60f5f7c3798b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:02.467302 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c2a10c9-0118-4dce-8ce9-60f5f7c3798b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:02.467302 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c2a10c9-0118-4dce-8ce9-60f5f7c3798b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:02.467302 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c2a10c9-0118-4dce-8ce9-60f5f7c3798b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:02.467742 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c2a10c9-0118-4dce-8ce9-60f5f7c3798b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:02.467742 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8c2a10c9-0118-4dce-8ce9-60f5f7c3798b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:02.609409 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.network.neutron [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] validate_networks() for [('85b65927-108e-4662-8841-432429780256', None, None, None, None, None)] {{(pid=121073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:07:02.718515 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8c2a10c9-0118-4dce-8ce9-60f5f7c3798b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:02.727022 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8c2a10c9-0118-4dce-8ce9-60f5f7c3798b tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1690 microversion: 2.1 time: 0.281725 Sep 23 14:07:02.728595 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 264/536] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:02 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1690 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:03.200901 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-69fb2602-a6ae-4e94-948b-95a8f76dedeb req-7ab62bc8-05a6-4450-b65f-e973d48ef17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6891295c-5fe6-44a7-adf2-f1fb03036261", "name": "network-vif-deleted", "tag": "51f6ed4d-0d8a-4bb4-bf7b-e42a43e05409"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:03.211677 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-69fb2602-a6ae-4e94-948b-95a8f76dedeb req-7ab62bc8-05a6-4450-b65f-e973d48ef17b service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:03.213030 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-69fb2602-a6ae-4e94-948b-95a8f76dedeb req-7ab62bc8-05a6-4450-b65f-e973d48ef17b service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:03.213730 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-69fb2602-a6ae-4e94-948b-95a8f76dedeb req-7ab62bc8-05a6-4450-b65f-e973d48ef17b service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:03.234069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-69fb2602-a6ae-4e94-948b-95a8f76dedeb req-7ab62bc8-05a6-4450-b65f-e973d48ef17b service nova] Creating event network-vif-deleted:51f6ed4d-0d8a-4bb4-bf7b-e42a43e05409 for instance 6891295c-5fe6-44a7-adf2-f1fb03036261 on hv-cinder-85743 Sep 23 14:07:03.244462 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-69fb2602-a6ae-4e94-948b-95a8f76dedeb req-7ab62bc8-05a6-4450-b65f-e973d48ef17b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047063 Sep 23 14:07:03.245415 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 265/537] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:03.257596 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Flavor limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:07:03.258039 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Image limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:07:03.258557 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Flavor pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:07:03.259037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Image pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:07:03.259461 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:07:03.268843 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:03.270201 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:03.270851 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:03.271751 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:03.272475 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:03.273166 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:03.293086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Getting quotas for project 901178273d85449e9cdaa5de235fb3e9. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:07:03.297282 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Getting quotas for user 9359e90c4861470d9cc060abb9c3b203 and project 901178273d85449e9cdaa5de235fb3e9. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:07:03.367158 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Going to run 1 instances... {{(pid=121073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:07:03.369484 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b5db45c-f08b-4d06-a01b-76d5c5896531',volume_size=None,volume_type=None)] {{(pid=121073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:07:03.754720 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5144ffdb-4ada-40cd-8461-ca4999663618 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:03.757981 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-5144ffdb-4ada-40cd-8461-ca4999663618 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:03.762918 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5144ffdb-4ada-40cd-8461-ca4999663618 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:03.763229 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5144ffdb-4ada-40cd-8461-ca4999663618 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:03.763678 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5144ffdb-4ada-40cd-8461-ca4999663618 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:03.764495 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5144ffdb-4ada-40cd-8461-ca4999663618 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:03.764960 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5144ffdb-4ada-40cd-8461-ca4999663618 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:03.765389 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5144ffdb-4ada-40cd-8461-ca4999663618 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:03.776610 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-2b1a63e0-72ea-43cf-badb-31fd2fc12628 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.328188 Sep 23 14:07:03.777997 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 273/538] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:07:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 14:07:03.809412 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-fb04a0b5-9bee-4565-9056-a18a966607bc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:03.810228 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-fb04a0b5-9bee-4565-9056-a18a966607bc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:03.841747 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5144ffdb-4ada-40cd-8461-ca4999663618 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:03.842242 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5144ffdb-4ada-40cd-8461-ca4999663618 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:03.842746 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5144ffdb-4ada-40cd-8461-ca4999663618 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:03.843244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-5144ffdb-4ada-40cd-8461-ca4999663618 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lazy-loading 'fault' on Instance uuid 6891295c-5fe6-44a7-adf2-f1fb03036261 {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:07:03.883773 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-fb04a0b5-9bee-4565-9056-a18a966607bc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:03.893138 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-fb04a0b5-9bee-4565-9056-a18a966607bc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1095 microversion: 2.1 time: 0.105592 Sep 23 14:07:03.894367 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 274/539] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:03 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1095 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:03.907834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5144ffdb-4ada-40cd-8461-ca4999663618 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:03.918051 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5144ffdb-4ada-40cd-8461-ca4999663618 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 200 len: 1334 microversion: 2.1 time: 0.168375 Sep 23 14:07:03.918862 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 266/540] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:03 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 1334 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:04.916710 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5deb147c-35b5-4167-bbd0-01c89db7980a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:04.917250 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5deb147c-35b5-4167-bbd0-01c89db7980a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:04.923675 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5deb147c-35b5-4167-bbd0-01c89db7980a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:04.924153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5deb147c-35b5-4167-bbd0-01c89db7980a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:04.924585 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5deb147c-35b5-4167-bbd0-01c89db7980a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:04.925266 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5deb147c-35b5-4167-bbd0-01c89db7980a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:04.925720 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5deb147c-35b5-4167-bbd0-01c89db7980a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:04.926138 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5deb147c-35b5-4167-bbd0-01c89db7980a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:04.941816 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-c2970bbf-bb22-44a9-aa18-b677bb5d1ac6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:04.944825 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-c2970bbf-bb22-44a9-aa18-b677bb5d1ac6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 6891295c-5fe6-44a7-adf2-f1fb03036261] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:04.949169 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c2970bbf-bb22-44a9-aa18-b677bb5d1ac6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:04.949658 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c2970bbf-bb22-44a9-aa18-b677bb5d1ac6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:04.950094 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c2970bbf-bb22-44a9-aa18-b677bb5d1ac6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:04.950828 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c2970bbf-bb22-44a9-aa18-b677bb5d1ac6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:04.951286 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c2970bbf-bb22-44a9-aa18-b677bb5d1ac6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:04.951713 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c2970bbf-bb22-44a9-aa18-b677bb5d1ac6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:04.965745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-c2970bbf-bb22-44a9-aa18-b677bb5d1ac6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] HTTP exception thrown: Instance 6891295c-5fe6-44a7-adf2-f1fb03036261 could not be found. Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-c2970bbf-bb22-44a9-aa18-b677bb5d1ac6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Request method failure captured: Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 HTTP/1.1 Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxnzDm6DgW0nTYDFDzi5SOHvSPJ6hZrF_pz9Ph0XCziqGU45FO9Ids8cW2I9WFrbXMdkl7DdqmLLFpEppSALkiMXJRcKEd-oKGJ1eeg29_bry9MG0PBEvVfdfr6Lqo4PU_2dBPb3P4fhNFCVeOEEyfkxVL-v3y86ZS4kPvYsqdra7o Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: d08a219027684089a91c354749c67d5d Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:07:04.967409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:07:04.968961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d08a219027684089a91c354749c67d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d08a219027684089a91c354749c67d5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d08a219027684089a91c354749c67d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d08a219027684089a91c354749c67d5d"}]}] Sep 23 14:07:04.968961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:07:04.968961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: d08a219027684089a91c354749c67d5d Sep 23 14:07:04.968961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:07:04.968961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-ServerRescueNegativeTestJSON-1299274290-project Sep 23 14:07:04.968961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:07:04.968961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:07:04.968961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 28b64a35d7b44519a1d93919f2e23083 Sep 23 14:07:04.968961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1299274290-project Sep 23 14:07:04.968961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:07:04.968961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance 6891295c-5fe6-44a7-adf2-f1fb03036261 could not be found. Sep 23 14:07:04.968961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': '6891295c-5fe6-44a7-adf2-f1fb03036261'} Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6891295c-5fe6-44a7-adf2-f1fb03036261 could not be found. Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:07:04.969879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6891295c-5fe6-44a7-adf2-f1fb03036261 could not be found. Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6891295c-5fe6-44a7-adf2-f1fb03036261 could not be found. Sep 23 14:07:04.972344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:04.974538 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-c2970bbf-bb22-44a9-aa18-b677bb5d1ac6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Returning 404 to user: Instance 6891295c-5fe6-44a7-adf2-f1fb03036261 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:07:04.974538 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-c2970bbf-bb22-44a9-aa18-b677bb5d1ac6 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261" status: 404 len: 111 microversion: 2.1 time: 0.030811 Sep 23 14:07:04.974538 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 267/541] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:04 2022] GET /compute/v2.1/servers/6891295c-5fe6-44a7-adf2-f1fb03036261 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:07:04.977416 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0451ec2b-2216-4199-8ad6-3c5870c278cd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '.version_select at 0x7f9083dab8b0>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:05.005248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5deb147c-35b5-4167-bbd0-01c89db7980a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:05.013706 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5deb147c-35b5-4167-bbd0-01c89db7980a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1145 microversion: 2.1 time: 0.101636 Sep 23 14:07:05.014267 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 275/542] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:04 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1145 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:05.069514 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-0451ec2b-2216-4199-8ad6-3c5870c278cd tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1044033894" status: 202 len: 0 microversion: 2.1 time: 0.095693 Sep 23 14:07:05.070094 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 268/543] 10.222.0.62 () {58 vars in 1221 bytes} [Fri Sep 23 14:07:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1044033894 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 14:07:06.036895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4db4d426-efe8-4d8e-bccd-27bfb83c7671 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:06.037508 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4db4d426-efe8-4d8e-bccd-27bfb83c7671 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:06.044145 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4db4d426-efe8-4d8e-bccd-27bfb83c7671 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:06.044629 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4db4d426-efe8-4d8e-bccd-27bfb83c7671 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:06.045068 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4db4d426-efe8-4d8e-bccd-27bfb83c7671 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:06.045753 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4db4d426-efe8-4d8e-bccd-27bfb83c7671 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:06.046212 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4db4d426-efe8-4d8e-bccd-27bfb83c7671 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:06.046669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4db4d426-efe8-4d8e-bccd-27bfb83c7671 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:06.050727 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:06.129360 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4db4d426-efe8-4d8e-bccd-27bfb83c7671 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:06.138649 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4db4d426-efe8-4d8e-bccd-27bfb83c7671 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1201 microversion: 2.1 time: 0.105438 Sep 23 14:07:06.139222 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 276/544] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:06 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1201 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:07.177727 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f35ebef5-bf69-488c-a871-d5c1ba76244a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:07.177727 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f35ebef5-bf69-488c-a871-d5c1ba76244a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:07.185924 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f35ebef5-bf69-488c-a871-d5c1ba76244a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:07.186508 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f35ebef5-bf69-488c-a871-d5c1ba76244a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:07.187147 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f35ebef5-bf69-488c-a871-d5c1ba76244a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:07.187865 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f35ebef5-bf69-488c-a871-d5c1ba76244a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:07.188461 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f35ebef5-bf69-488c-a871-d5c1ba76244a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:07.189061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f35ebef5-bf69-488c-a871-d5c1ba76244a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:07.459879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f35ebef5-bf69-488c-a871-d5c1ba76244a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:07.468560 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f35ebef5-bf69-488c-a871-d5c1ba76244a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1278 microversion: 2.1 time: 0.308915 Sep 23 14:07:07.469144 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 269/545] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:07 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1278 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:08.053470 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-0ddc5ad3-209f-472f-a1e7-ccaa862ccf7c req-af246d68-75e0-4ece-95d3-730f1203d08a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817ae959-3342-4926-9f60-e4a24124a282", "tag": "c3a78cda-14d8-495c-98ba-ab806fda32b8"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:08.064154 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-0ddc5ad3-209f-472f-a1e7-ccaa862ccf7c req-af246d68-75e0-4ece-95d3-730f1203d08a service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:08.064636 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-0ddc5ad3-209f-472f-a1e7-ccaa862ccf7c req-af246d68-75e0-4ece-95d3-730f1203d08a service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:08.065066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-0ddc5ad3-209f-472f-a1e7-ccaa862ccf7c req-af246d68-75e0-4ece-95d3-730f1203d08a service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:08.077084 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-0ddc5ad3-209f-472f-a1e7-ccaa862ccf7c req-af246d68-75e0-4ece-95d3-730f1203d08a service nova] Creating event network-changed:c3a78cda-14d8-495c-98ba-ab806fda32b8 for instance 817ae959-3342-4926-9f60-e4a24124a282 on hv-cinder-85743 Sep 23 14:07:08.082046 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-0ddc5ad3-209f-472f-a1e7-ccaa862ccf7c req-af246d68-75e0-4ece-95d3-730f1203d08a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033868 Sep 23 14:07:08.082766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 277/546] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:08.343405 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-363c01ca-8175-47ef-91d8-a7f2917c081c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:08.343905 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-363c01ca-8175-47ef-91d8-a7f2917c081c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:08.349876 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-363c01ca-8175-47ef-91d8-a7f2917c081c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:08.350392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-363c01ca-8175-47ef-91d8-a7f2917c081c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:08.350833 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-363c01ca-8175-47ef-91d8-a7f2917c081c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:08.351524 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-363c01ca-8175-47ef-91d8-a7f2917c081c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:08.351982 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-363c01ca-8175-47ef-91d8-a7f2917c081c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:08.352412 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-363c01ca-8175-47ef-91d8-a7f2917c081c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:08.377592 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-363c01ca-8175-47ef-91d8-a7f2917c081c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Going to try to terminate instance {{(pid=121074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:07:08.492705 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3f82ca6f-1a58-41e6-86cc-07962aac91c8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:08.493421 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3f82ca6f-1a58-41e6-86cc-07962aac91c8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:08.504672 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f82ca6f-1a58-41e6-86cc-07962aac91c8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:08.504672 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f82ca6f-1a58-41e6-86cc-07962aac91c8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:08.504672 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f82ca6f-1a58-41e6-86cc-07962aac91c8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:08.504672 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f82ca6f-1a58-41e6-86cc-07962aac91c8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:08.505036 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f82ca6f-1a58-41e6-86cc-07962aac91c8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:08.505036 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f82ca6f-1a58-41e6-86cc-07962aac91c8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:08.624456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-363c01ca-8175-47ef-91d8-a7f2917c081c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "DELETE /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 204 len: 0 microversion: 2.1 time: 0.284549 Sep 23 14:07:08.627998 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 270/547] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:07:08 2022] DELETE /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:07:08.633709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-501841f8-6d3a-44fb-8858-882a7147296d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:08.634531 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-501841f8-6d3a-44fb-8858-882a7147296d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:08.641271 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-501841f8-6d3a-44fb-8858-882a7147296d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:08.641761 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-501841f8-6d3a-44fb-8858-882a7147296d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:08.642203 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-501841f8-6d3a-44fb-8858-882a7147296d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:08.642929 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-501841f8-6d3a-44fb-8858-882a7147296d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:08.643391 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-501841f8-6d3a-44fb-8858-882a7147296d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:08.643818 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-501841f8-6d3a-44fb-8858-882a7147296d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:08.803775 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3f82ca6f-1a58-41e6-86cc-07962aac91c8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:08.815058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3f82ca6f-1a58-41e6-86cc-07962aac91c8 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.326468 Sep 23 14:07:08.815556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 278/548] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:08 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:08.826276 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-501841f8-6d3a-44fb-8858-882a7147296d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:08.829734 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:08.834286 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-501841f8-6d3a-44fb-8858-882a7147296d tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1508 microversion: 2.1 time: 0.204842 Sep 23 14:07:08.834871 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 271/549] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:08 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:09.838175 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-50b071d5-6f18-445d-a67f-53e130d25230 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:09.839728 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-50b071d5-6f18-445d-a67f-53e130d25230 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:09.846062 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-50b071d5-6f18-445d-a67f-53e130d25230 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:09.846584 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-50b071d5-6f18-445d-a67f-53e130d25230 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:09.847028 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-50b071d5-6f18-445d-a67f-53e130d25230 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:09.847716 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-50b071d5-6f18-445d-a67f-53e130d25230 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:09.848175 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-50b071d5-6f18-445d-a67f-53e130d25230 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:09.848603 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-50b071d5-6f18-445d-a67f-53e130d25230 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:09.857407 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d13b50ae-92f4-4f18-b124-4780644445ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:09.858025 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d13b50ae-92f4-4f18-b124-4780644445ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:09.864776 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d13b50ae-92f4-4f18-b124-4780644445ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:09.865267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d13b50ae-92f4-4f18-b124-4780644445ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:09.865741 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d13b50ae-92f4-4f18-b124-4780644445ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:09.866517 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d13b50ae-92f4-4f18-b124-4780644445ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:09.866977 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d13b50ae-92f4-4f18-b124-4780644445ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:09.867408 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d13b50ae-92f4-4f18-b124-4780644445ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:10.020293 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-50b071d5-6f18-445d-a67f-53e130d25230 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:10.028301 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-50b071d5-6f18-445d-a67f-53e130d25230 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.193982 Sep 23 14:07:10.028957 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 279/550] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:09 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:10.033827 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-efd3b5fc-2bd4-49f6-9db7-51f902f3aa3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:10.034419 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-efd3b5fc-2bd4-49f6-9db7-51f902f3aa3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:10.041615 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-efd3b5fc-2bd4-49f6-9db7-51f902f3aa3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:10.042253 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-efd3b5fc-2bd4-49f6-9db7-51f902f3aa3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:10.042776 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-efd3b5fc-2bd4-49f6-9db7-51f902f3aa3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:10.049219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-efd3b5fc-2bd4-49f6-9db7-51f902f3aa3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:10.049219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-efd3b5fc-2bd4-49f6-9db7-51f902f3aa3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:10.049219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-efd3b5fc-2bd4-49f6-9db7-51f902f3aa3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:10.074404 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-efd3b5fc-2bd4-49f6-9db7-51f902f3aa3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/os-volume_attachments/fcb463ed-1920-4c95-b596-e0ba4f14bfb1" status: 200 len: 194 microversion: 2.20 time: 0.044317 Sep 23 14:07:10.075005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 280/551] 10.222.0.62 () {60 vars in 1454 bytes} [Fri Sep 23 14:07:10 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/os-volume_attachments/fcb463ed-1920-4c95-b596-e0ba4f14bfb1 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 14:07:10.089831 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d13b50ae-92f4-4f18-b124-4780644445ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:10.094834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d13b50ae-92f4-4f18-b124-4780644445ff tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1508 microversion: 2.1 time: 0.241635 Sep 23 14:07:10.095413 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 272/552] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:09 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1508 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:10.147754 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-749128c6-b6fc-4d1a-94b9-cd842f5cc679 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:10.148481 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-749128c6-b6fc-4d1a-94b9-cd842f5cc679 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:10.154990 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-749128c6-b6fc-4d1a-94b9-cd842f5cc679 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:10.155548 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-749128c6-b6fc-4d1a-94b9-cd842f5cc679 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:10.156293 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-749128c6-b6fc-4d1a-94b9-cd842f5cc679 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:10.156868 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-749128c6-b6fc-4d1a-94b9-cd842f5cc679 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:10.157531 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-749128c6-b6fc-4d1a-94b9-cd842f5cc679 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:10.158285 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-749128c6-b6fc-4d1a-94b9-cd842f5cc679 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:10.248184 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-749128c6-b6fc-4d1a-94b9-cd842f5cc679 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lazy-loading 'services' on Instance uuid 97557fbe-c1f4-464e-93b8-3c71fbc48936 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:07:10.469425 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-749128c6-b6fc-4d1a-94b9-cd842f5cc679 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "DELETE /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/os-volume_attachments/fcb463ed-1920-4c95-b596-e0ba4f14bfb1" status: 202 len: 0 microversion: 2.20 time: 0.325517 Sep 23 14:07:10.469940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 281/553] 10.222.0.62 () {60 vars in 1457 bytes} [Fri Sep 23 14:07:10 2022] DELETE /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/os-volume_attachments/fcb463ed-1920-4c95-b596-e0ba4f14bfb1 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:07:10.478493 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-45fd5edd-696c-4a14-86ed-43a9fcac9b7b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:10.480968 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-45fd5edd-696c-4a14-86ed-43a9fcac9b7b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:10.486900 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-45fd5edd-696c-4a14-86ed-43a9fcac9b7b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:10.487386 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-45fd5edd-696c-4a14-86ed-43a9fcac9b7b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:10.487839 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-45fd5edd-696c-4a14-86ed-43a9fcac9b7b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:10.488510 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-45fd5edd-696c-4a14-86ed-43a9fcac9b7b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:10.488963 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-45fd5edd-696c-4a14-86ed-43a9fcac9b7b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:10.489402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-45fd5edd-696c-4a14-86ed-43a9fcac9b7b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:10.518981 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-45fd5edd-696c-4a14-86ed-43a9fcac9b7b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044530 Sep 23 14:07:10.519529 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 273/554] 10.222.0.62 () {60 vars in 1343 bytes} [Fri Sep 23 14:07:10 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 14:07:11.053046 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8c3f56a4-89a9-42e0-9661-3155a8570745 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:11.054188 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-8c3f56a4-89a9-42e0-9661-3155a8570745 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:11.060903 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8c3f56a4-89a9-42e0-9661-3155a8570745 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:11.061385 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8c3f56a4-89a9-42e0-9661-3155a8570745 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:11.061852 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8c3f56a4-89a9-42e0-9661-3155a8570745 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:11.062576 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8c3f56a4-89a9-42e0-9661-3155a8570745 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:11.063030 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8c3f56a4-89a9-42e0-9661-3155a8570745 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:11.063455 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8c3f56a4-89a9-42e0-9661-3155a8570745 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:11.116896 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-047c8886-dd66-415c-85ca-cf1fb28c4e42 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:11.117528 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-047c8886-dd66-415c-85ca-cf1fb28c4e42 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:11.124461 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-047c8886-dd66-415c-85ca-cf1fb28c4e42 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:11.124948 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-047c8886-dd66-415c-85ca-cf1fb28c4e42 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:11.125386 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-047c8886-dd66-415c-85ca-cf1fb28c4e42 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:11.126078 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-047c8886-dd66-415c-85ca-cf1fb28c4e42 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:11.126560 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-047c8886-dd66-415c-85ca-cf1fb28c4e42 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:11.126988 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-047c8886-dd66-415c-85ca-cf1fb28c4e42 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:11.507350 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-8c3f56a4-89a9-42e0-9661-3155a8570745 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:11.515406 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8c3f56a4-89a9-42e0-9661-3155a8570745 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.467015 Sep 23 14:07:11.515970 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 282/555] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:11 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:11.532272 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f4800ab3-cca8-4f17-b16f-2988d27eec43 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:11.534431 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f4800ab3-cca8-4f17-b16f-2988d27eec43 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:11.540315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4800ab3-cca8-4f17-b16f-2988d27eec43 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:11.540806 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4800ab3-cca8-4f17-b16f-2988d27eec43 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:11.541243 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4800ab3-cca8-4f17-b16f-2988d27eec43 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:11.541930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4800ab3-cca8-4f17-b16f-2988d27eec43 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:11.543060 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4800ab3-cca8-4f17-b16f-2988d27eec43 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:11.543496 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4800ab3-cca8-4f17-b16f-2988d27eec43 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:11.575785 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f4800ab3-cca8-4f17-b16f-2988d27eec43 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047624 Sep 23 14:07:11.576354 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 283/556] 10.222.0.62 () {60 vars in 1343 bytes} [Fri Sep 23 14:07:11 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 14:07:11.590536 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-047c8886-dd66-415c-85ca-cf1fb28c4e42 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:11.598047 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-047c8886-dd66-415c-85ca-cf1fb28c4e42 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1508 microversion: 2.1 time: 0.484926 Sep 23 14:07:11.598662 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 274/557] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:11 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1508 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:12.231112 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-7cb6a122-18ad-4eaa-8666-f1e0d2d9683e req-92bc76a6-2d29-42d8-88f0-9308c86fb612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ff0e5b-c9cf-409f-a993-a5969225c7bf", "name": "network-vif-deleted", "tag": "08c333a2-80db-4cb2-8c18-245c61e87e9a"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:12.241348 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-7cb6a122-18ad-4eaa-8666-f1e0d2d9683e req-92bc76a6-2d29-42d8-88f0-9308c86fb612 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:12.241919 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-7cb6a122-18ad-4eaa-8666-f1e0d2d9683e req-92bc76a6-2d29-42d8-88f0-9308c86fb612 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:12.242454 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-7cb6a122-18ad-4eaa-8666-f1e0d2d9683e req-92bc76a6-2d29-42d8-88f0-9308c86fb612 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:12.253720 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-7cb6a122-18ad-4eaa-8666-f1e0d2d9683e req-92bc76a6-2d29-42d8-88f0-9308c86fb612 service nova] Creating event network-vif-deleted:08c333a2-80db-4cb2-8c18-245c61e87e9a for instance 00ff0e5b-c9cf-409f-a993-a5969225c7bf on hv-cinder-85743 Sep 23 14:07:12.258869 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-7cb6a122-18ad-4eaa-8666-f1e0d2d9683e req-92bc76a6-2d29-42d8-88f0-9308c86fb612 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032025 Sep 23 14:07:12.259464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 284/558] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:12.539055 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-52f84c32-f756-4648-a750-c167d5c5dd40 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:12.539673 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-52f84c32-f756-4648-a750-c167d5c5dd40 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:12.546252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-52f84c32-f756-4648-a750-c167d5c5dd40 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:12.546793 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-52f84c32-f756-4648-a750-c167d5c5dd40 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:12.547238 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-52f84c32-f756-4648-a750-c167d5c5dd40 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:12.547940 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-52f84c32-f756-4648-a750-c167d5c5dd40 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:12.548402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-52f84c32-f756-4648-a750-c167d5c5dd40 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:12.548903 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-52f84c32-f756-4648-a750-c167d5c5dd40 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:12.588930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-26427795-6e70-4166-830f-73142cfbc70b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:12.592247 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-26427795-6e70-4166-830f-73142cfbc70b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:12.598862 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-26427795-6e70-4166-830f-73142cfbc70b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:12.599452 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-26427795-6e70-4166-830f-73142cfbc70b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:12.600087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-26427795-6e70-4166-830f-73142cfbc70b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:12.600956 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-26427795-6e70-4166-830f-73142cfbc70b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:12.601567 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-26427795-6e70-4166-830f-73142cfbc70b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:12.602176 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-26427795-6e70-4166-830f-73142cfbc70b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:12.638142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-26427795-6e70-4166-830f-73142cfbc70b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054191 Sep 23 14:07:12.644423 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 285/559] 10.222.0.62 () {60 vars in 1343 bytes} [Fri Sep 23 14:07:12 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:12.644423 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-852fa50e-21b0-48ac-a6cd-8ae53dbdb373 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:12.644790 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-852fa50e-21b0-48ac-a6cd-8ae53dbdb373 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:12.656565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-852fa50e-21b0-48ac-a6cd-8ae53dbdb373 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:12.656565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-852fa50e-21b0-48ac-a6cd-8ae53dbdb373 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:12.656565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-852fa50e-21b0-48ac-a6cd-8ae53dbdb373 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:12.656565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-852fa50e-21b0-48ac-a6cd-8ae53dbdb373 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:12.657016 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-852fa50e-21b0-48ac-a6cd-8ae53dbdb373 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:12.657016 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-852fa50e-21b0-48ac-a6cd-8ae53dbdb373 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:12.695484 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-852fa50e-21b0-48ac-a6cd-8ae53dbdb373 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:12.695484 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-852fa50e-21b0-48ac-a6cd-8ae53dbdb373 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:12.695484 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-852fa50e-21b0-48ac-a6cd-8ae53dbdb373 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:12.695484 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-852fa50e-21b0-48ac-a6cd-8ae53dbdb373 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lazy-loading 'fault' on Instance uuid 00ff0e5b-c9cf-409f-a993-a5969225c7bf {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:07:12.701921 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-52f84c32-f756-4648-a750-c167d5c5dd40 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:12.710739 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-52f84c32-f756-4648-a750-c167d5c5dd40 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.175822 Sep 23 14:07:12.711299 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 275/560] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:12 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:12.724014 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-22c4521c-702d-431f-abec-c8ba401bd54b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:12.724640 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-22c4521c-702d-431f-abec-c8ba401bd54b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:12.731282 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22c4521c-702d-431f-abec-c8ba401bd54b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:12.732296 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22c4521c-702d-431f-abec-c8ba401bd54b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:12.732451 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22c4521c-702d-431f-abec-c8ba401bd54b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:12.733351 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22c4521c-702d-431f-abec-c8ba401bd54b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:12.733915 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22c4521c-702d-431f-abec-c8ba401bd54b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:12.734578 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22c4521c-702d-431f-abec-c8ba401bd54b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:12.737560 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-852fa50e-21b0-48ac-a6cd-8ae53dbdb373 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:12.746940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-852fa50e-21b0-48ac-a6cd-8ae53dbdb373 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1312 microversion: 2.1 time: 0.105344 Sep 23 14:07:12.746940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 286/561] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:12 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:12.760820 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-22c4521c-702d-431f-abec-c8ba401bd54b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Going to try to terminate instance {{(pid=121074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:07:13.070061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-22c4521c-702d-431f-abec-c8ba401bd54b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "DELETE /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 204 len: 0 microversion: 2.20 time: 0.350008 Sep 23 14:07:13.070679 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 276/562] 10.222.0.62 () {60 vars in 1280 bytes} [Fri Sep 23 14:07:12 2022] DELETE /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 14:07:13.079596 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3f02b8d3-6a3d-42a5-b5f6-7d75e051dc8a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:13.080213 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3f02b8d3-6a3d-42a5-b5f6-7d75e051dc8a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:13.086120 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f02b8d3-6a3d-42a5-b5f6-7d75e051dc8a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:13.086634 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f02b8d3-6a3d-42a5-b5f6-7d75e051dc8a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:13.087068 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f02b8d3-6a3d-42a5-b5f6-7d75e051dc8a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:13.087746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f02b8d3-6a3d-42a5-b5f6-7d75e051dc8a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:13.088197 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f02b8d3-6a3d-42a5-b5f6-7d75e051dc8a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:13.088619 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f02b8d3-6a3d-42a5-b5f6-7d75e051dc8a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:13.220463 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3f02b8d3-6a3d-42a5-b5f6-7d75e051dc8a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:13.228501 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3f02b8d3-6a3d-42a5-b5f6-7d75e051dc8a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:13.229948 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3f02b8d3-6a3d-42a5-b5f6-7d75e051dc8a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:13.231343 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3f02b8d3-6a3d-42a5-b5f6-7d75e051dc8a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.155578 Sep 23 14:07:13.231897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 287/563] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:13 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:13.735566 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-dcd02d46-1f61-4a54-b3c3-41ad05bc08d4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:13.736262 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-dcd02d46-1f61-4a54-b3c3-41ad05bc08d4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:13.742271 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dcd02d46-1f61-4a54-b3c3-41ad05bc08d4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:13.742795 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dcd02d46-1f61-4a54-b3c3-41ad05bc08d4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:13.743230 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dcd02d46-1f61-4a54-b3c3-41ad05bc08d4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:13.744069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dcd02d46-1f61-4a54-b3c3-41ad05bc08d4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:13.744372 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dcd02d46-1f61-4a54-b3c3-41ad05bc08d4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:13.744797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dcd02d46-1f61-4a54-b3c3-41ad05bc08d4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:13.769527 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-0891e332-4435-4f76-b7ac-30b868e798a3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:13.770143 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-0891e332-4435-4f76-b7ac-30b868e798a3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:13.772662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:13.777558 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0891e332-4435-4f76-b7ac-30b868e798a3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:13.778076 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0891e332-4435-4f76-b7ac-30b868e798a3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:13.778547 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0891e332-4435-4f76-b7ac-30b868e798a3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:13.779243 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0891e332-4435-4f76-b7ac-30b868e798a3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:13.779736 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0891e332-4435-4f76-b7ac-30b868e798a3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:13.780199 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0891e332-4435-4f76-b7ac-30b868e798a3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:13.822552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0891e332-4435-4f76-b7ac-30b868e798a3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:13.823189 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0891e332-4435-4f76-b7ac-30b868e798a3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:13.823693 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0891e332-4435-4f76-b7ac-30b868e798a3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:13.824845 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-0891e332-4435-4f76-b7ac-30b868e798a3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lazy-loading 'fault' on Instance uuid 00ff0e5b-c9cf-409f-a993-a5969225c7bf {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:07:13.887874 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-0891e332-4435-4f76-b7ac-30b868e798a3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:13.893664 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=8 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:13.896409 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-0891e332-4435-4f76-b7ac-30b868e798a3 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 200 len: 1312 microversion: 2.1 time: 0.130657 Sep 23 14:07:13.897061 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 288/564] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:13 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 1312 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:13.908685 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-dcd02d46-1f61-4a54-b3c3-41ad05bc08d4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:13.915510 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-dcd02d46-1f61-4a54-b3c3-41ad05bc08d4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.184171 Sep 23 14:07:13.916079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 277/565] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:13 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:14.259602 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6fecb6a7-6dd8-44aa-970e-56dbf21ceea7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:14.260203 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-6fecb6a7-6dd8-44aa-970e-56dbf21ceea7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:14.266804 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6fecb6a7-6dd8-44aa-970e-56dbf21ceea7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:14.267283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6fecb6a7-6dd8-44aa-970e-56dbf21ceea7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:14.267719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6fecb6a7-6dd8-44aa-970e-56dbf21ceea7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:14.268401 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6fecb6a7-6dd8-44aa-970e-56dbf21ceea7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:14.268857 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6fecb6a7-6dd8-44aa-970e-56dbf21ceea7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:14.269280 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6fecb6a7-6dd8-44aa-970e-56dbf21ceea7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:14.299732 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-54f71ba4-4803-40a0-9808-d35d605b693b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:14.300219 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-54f71ba4-4803-40a0-9808-d35d605b693b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:14.306574 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54f71ba4-4803-40a0-9808-d35d605b693b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:14.307058 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54f71ba4-4803-40a0-9808-d35d605b693b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:14.307490 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54f71ba4-4803-40a0-9808-d35d605b693b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:14.308168 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54f71ba4-4803-40a0-9808-d35d605b693b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:14.309191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54f71ba4-4803-40a0-9808-d35d605b693b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:14.309616 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54f71ba4-4803-40a0-9808-d35d605b693b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:14.333490 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-54f71ba4-4803-40a0-9808-d35d605b693b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/ips" status: 200 len: 150 microversion: 2.1 time: 0.037443 Sep 23 14:07:14.334107 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 278/566] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 23 14:07:14 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:14.397559 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-6fecb6a7-6dd8-44aa-970e-56dbf21ceea7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:14.406857 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-6fecb6a7-6dd8-44aa-970e-56dbf21ceea7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:14.408337 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-6fecb6a7-6dd8-44aa-970e-56dbf21ceea7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:14.409488 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-6fecb6a7-6dd8-44aa-970e-56dbf21ceea7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.153836 Sep 23 14:07:14.410268 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 289/567] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:14 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:14.919414 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d0c54700-f31a-4b4d-81ce-e7198e2663d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:14.925266 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d0c54700-f31a-4b4d-81ce-e7198e2663d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 00ff0e5b-c9cf-409f-a993-a5969225c7bf] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:14.926122 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d0c54700-f31a-4b4d-81ce-e7198e2663d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:14.926668 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d0c54700-f31a-4b4d-81ce-e7198e2663d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:14.927108 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d0c54700-f31a-4b4d-81ce-e7198e2663d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:14.927819 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d0c54700-f31a-4b4d-81ce-e7198e2663d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:14.928848 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d0c54700-f31a-4b4d-81ce-e7198e2663d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:14.929439 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d0c54700-f31a-4b4d-81ce-e7198e2663d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:14.939618 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1275d3c1-35aa-44fa-b42e-cc4570350952 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:14.940835 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1275d3c1-35aa-44fa-b42e-cc4570350952 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:14.943956 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-d0c54700-f31a-4b4d-81ce-e7198e2663d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] HTTP exception thrown: Instance 00ff0e5b-c9cf-409f-a993-a5969225c7bf could not be found. Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d0c54700-f31a-4b4d-81ce-e7198e2663d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Request method failure captured: Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf HTTP/1.1 Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxnzDm6DgW0nTYDFDzi5SOHvSPJ6hZrF_pz9Ph0XCziqGU45FO9Ids8cW2I9WFrbXMdkl7DdqmLLFpEppSALkiMXJRcKEd-oKGJ1eeg29_bry9MG0PBEvVfdfr6Lqo4PU_2dBPb3P4fhNFCVeOEEyfkxVL-v3y86ZS4kPvYsqdra7o Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: d08a219027684089a91c354749c67d5d Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:07:14.945606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:07:14.947024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d08a219027684089a91c354749c67d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d08a219027684089a91c354749c67d5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d08a219027684089a91c354749c67d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d08a219027684089a91c354749c67d5d"}]}] Sep 23 14:07:14.947024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:07:14.947024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: d08a219027684089a91c354749c67d5d Sep 23 14:07:14.947024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:07:14.947024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-ServerRescueNegativeTestJSON-1299274290-project Sep 23 14:07:14.947024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:07:14.947024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:07:14.947024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 28b64a35d7b44519a1d93919f2e23083 Sep 23 14:07:14.947024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1299274290-project Sep 23 14:07:14.947024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:07:14.947024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance 00ff0e5b-c9cf-409f-a993-a5969225c7bf could not be found. Sep 23 14:07:14.947024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': '00ff0e5b-c9cf-409f-a993-a5969225c7bf'} Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ff0e5b-c9cf-409f-a993-a5969225c7bf could not be found. Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:07:14.947769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ff0e5b-c9cf-409f-a993-a5969225c7bf could not be found. Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ff0e5b-c9cf-409f-a993-a5969225c7bf could not be found. Sep 23 14:07:14.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:14.950878 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d0c54700-f31a-4b4d-81ce-e7198e2663d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Returning 404 to user: Instance 00ff0e5b-c9cf-409f-a993-a5969225c7bf could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:07:14.950965 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:14.951044 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d0c54700-f31a-4b4d-81ce-e7198e2663d1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf" status: 404 len: 111 microversion: 2.1 time: 0.031705 Sep 23 14:07:14.951124 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1275d3c1-35aa-44fa-b42e-cc4570350952 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:14.951124 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1275d3c1-35aa-44fa-b42e-cc4570350952 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:14.951124 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1275d3c1-35aa-44fa-b42e-cc4570350952 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:14.951378 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 279/568] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:14 2022] GET /compute/v2.1/servers/00ff0e5b-c9cf-409f-a993-a5969225c7bf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:07:14.952088 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1275d3c1-35aa-44fa-b42e-cc4570350952 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:14.952553 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1275d3c1-35aa-44fa-b42e-cc4570350952 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:14.953034 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1275d3c1-35aa-44fa-b42e-cc4570350952 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:14.956573 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-634634dd-fb80-4bbd-a4b1-e5eb79fc0313 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:14.957133 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-634634dd-fb80-4bbd-a4b1-e5eb79fc0313 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:14.963225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-634634dd-fb80-4bbd-a4b1-e5eb79fc0313 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:14.963717 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-634634dd-fb80-4bbd-a4b1-e5eb79fc0313 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:14.964160 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-634634dd-fb80-4bbd-a4b1-e5eb79fc0313 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:14.965563 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-634634dd-fb80-4bbd-a4b1-e5eb79fc0313 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:14.966486 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-634634dd-fb80-4bbd-a4b1-e5eb79fc0313 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:14.966922 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-634634dd-fb80-4bbd-a4b1-e5eb79fc0313 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:14.993223 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-634634dd-fb80-4bbd-a4b1-e5eb79fc0313 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Going to try to terminate instance {{(pid=121074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:07:15.094102 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1275d3c1-35aa-44fa-b42e-cc4570350952 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:15.101804 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1275d3c1-35aa-44fa-b42e-cc4570350952 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.166697 Sep 23 14:07:15.102495 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 290/569] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:14 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:15.240595 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-634634dd-fb80-4bbd-a4b1-e5eb79fc0313 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 204 len: 0 microversion: 2.1 time: 0.287535 Sep 23 14:07:15.241193 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 280/570] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:07:14 2022] DELETE /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:07:15.307605 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1d4dcfd8-86f8-483c-9b8d-3cd01113d839 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:15.308222 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1d4dcfd8-86f8-483c-9b8d-3cd01113d839 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:15.315397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d4dcfd8-86f8-483c-9b8d-3cd01113d839 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:15.315891 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d4dcfd8-86f8-483c-9b8d-3cd01113d839 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:15.316336 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d4dcfd8-86f8-483c-9b8d-3cd01113d839 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:15.317029 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d4dcfd8-86f8-483c-9b8d-3cd01113d839 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:15.317491 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d4dcfd8-86f8-483c-9b8d-3cd01113d839 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:15.318037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d4dcfd8-86f8-483c-9b8d-3cd01113d839 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:15.437784 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-06aa8354-a693-4da2-9a31-7812ceab602a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:15.438710 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-06aa8354-a693-4da2-9a31-7812ceab602a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:15.445670 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06aa8354-a693-4da2-9a31-7812ceab602a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:15.446164 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06aa8354-a693-4da2-9a31-7812ceab602a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:15.446693 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06aa8354-a693-4da2-9a31-7812ceab602a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:15.447447 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06aa8354-a693-4da2-9a31-7812ceab602a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:15.447968 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06aa8354-a693-4da2-9a31-7812ceab602a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:15.448577 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06aa8354-a693-4da2-9a31-7812ceab602a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:15.449283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1d4dcfd8-86f8-483c-9b8d-3cd01113d839 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:15.458962 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1d4dcfd8-86f8-483c-9b8d-3cd01113d839 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.213462 Sep 23 14:07:15.459539 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 291/571] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:15 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:15.584592 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-06aa8354-a693-4da2-9a31-7812ceab602a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:15.593105 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-06aa8354-a693-4da2-9a31-7812ceab602a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:15.594602 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-06aa8354-a693-4da2-9a31-7812ceab602a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:15.595734 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-06aa8354-a693-4da2-9a31-7812ceab602a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1725 microversion: 2.20 time: 0.163764 Sep 23 14:07:15.596299 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 281/572] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:15 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:07:15.934608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4a465f8c-fe79-4075-bcca-8fc934d4dab1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f45ddfea-b90d-4971-b1db-42c5f121b704"}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:15.937084 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4a465f8c-fe79-4075-bcca-8fc934d4dab1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:15.943071 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a465f8c-fe79-4075-bcca-8fc934d4dab1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:15.943570 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a465f8c-fe79-4075-bcca-8fc934d4dab1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:15.944017 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a465f8c-fe79-4075-bcca-8fc934d4dab1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:15.944715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a465f8c-fe79-4075-bcca-8fc934d4dab1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:15.945179 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a465f8c-fe79-4075-bcca-8fc934d4dab1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:15.945610 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a465f8c-fe79-4075-bcca-8fc934d4dab1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:16.017003 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:16.100556 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-e1d49ee8-0dfc-47cd-bb0a-e0fa3b132867 req-d4dd3624-5b15-4e44-90b0-ec992618a074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97557fbe-c1f4-464e-93b8-3c71fbc48936", "name": "network-vif-deleted", "tag": "0765d95c-b5b8-4eb9-aef1-96129a9a206d"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:16.110452 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-e1d49ee8-0dfc-47cd-bb0a-e0fa3b132867 req-d4dd3624-5b15-4e44-90b0-ec992618a074 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:16.110928 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-e1d49ee8-0dfc-47cd-bb0a-e0fa3b132867 req-d4dd3624-5b15-4e44-90b0-ec992618a074 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:16.111745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-e1d49ee8-0dfc-47cd-bb0a-e0fa3b132867 req-d4dd3624-5b15-4e44-90b0-ec992618a074 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:16.123586 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-e1d49ee8-0dfc-47cd-bb0a-e0fa3b132867 req-d4dd3624-5b15-4e44-90b0-ec992618a074 service nova] Creating event network-vif-deleted:0765d95c-b5b8-4eb9-aef1-96129a9a206d for instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 on hv-cinder-85743 Sep 23 14:07:16.128500 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-e1d49ee8-0dfc-47cd-bb0a-e0fa3b132867 req-d4dd3624-5b15-4e44-90b0-ec992618a074 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031608 Sep 23 14:07:16.129134 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 282/573] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:16.136136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ba8d622d-5987-43f1-a9cb-37eff98f4332 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:16.136136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ba8d622d-5987-43f1-a9cb-37eff98f4332 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:16.141711 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ba8d622d-5987-43f1-a9cb-37eff98f4332 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:16.142242 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ba8d622d-5987-43f1-a9cb-37eff98f4332 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:16.142825 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ba8d622d-5987-43f1-a9cb-37eff98f4332 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:16.143571 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ba8d622d-5987-43f1-a9cb-37eff98f4332 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:16.144023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ba8d622d-5987-43f1-a9cb-37eff98f4332 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:16.144449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ba8d622d-5987-43f1-a9cb-37eff98f4332 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:16.296095 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ba8d622d-5987-43f1-a9cb-37eff98f4332 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:16.304296 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ba8d622d-5987-43f1-a9cb-37eff98f4332 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.173749 Sep 23 14:07:16.304881 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 283/574] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:16 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:16.482129 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ce5e2dfa-8833-48cc-bf36-dd864563130c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:16.482779 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ce5e2dfa-8833-48cc-bf36-dd864563130c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:16.489008 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ce5e2dfa-8833-48cc-bf36-dd864563130c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:16.489423 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ce5e2dfa-8833-48cc-bf36-dd864563130c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:16.489860 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ce5e2dfa-8833-48cc-bf36-dd864563130c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:16.490593 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ce5e2dfa-8833-48cc-bf36-dd864563130c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:16.491053 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ce5e2dfa-8833-48cc-bf36-dd864563130c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:16.491483 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ce5e2dfa-8833-48cc-bf36-dd864563130c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:16.624818 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ce5e2dfa-8833-48cc-bf36-dd864563130c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:16.633629 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ce5e2dfa-8833-48cc-bf36-dd864563130c tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.155641 Sep 23 14:07:16.634595 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 284/575] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:16 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:16.640983 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5f5fb9e1-9919-4a6e-a140-4359614571c1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:16.641690 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-5f5fb9e1-9919-4a6e-a140-4359614571c1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:16.647695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5f5fb9e1-9919-4a6e-a140-4359614571c1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:16.648292 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5f5fb9e1-9919-4a6e-a140-4359614571c1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:16.648829 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5f5fb9e1-9919-4a6e-a140-4359614571c1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:16.649621 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5f5fb9e1-9919-4a6e-a140-4359614571c1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:16.650191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5f5fb9e1-9919-4a6e-a140-4359614571c1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:16.650850 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5f5fb9e1-9919-4a6e-a140-4359614571c1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:16.716971 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5f5fb9e1-9919-4a6e-a140-4359614571c1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:16.724997 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5f5fb9e1-9919-4a6e-a140-4359614571c1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:16.726453 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5f5fb9e1-9919-4a6e-a140-4359614571c1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:16.727596 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5f5fb9e1-9919-4a6e-a140-4359614571c1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1657 microversion: 2.20 time: 0.092072 Sep 23 14:07:16.728153 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 285/576] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:16 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1657 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:17.329350 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b8374843-7d97-45c6-ac77-79bf6b784229 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:17.334550 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b8374843-7d97-45c6-ac77-79bf6b784229 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:17.336095 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8374843-7d97-45c6-ac77-79bf6b784229 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:17.336578 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8374843-7d97-45c6-ac77-79bf6b784229 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:17.337010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8374843-7d97-45c6-ac77-79bf6b784229 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:17.337691 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8374843-7d97-45c6-ac77-79bf6b784229 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:17.338143 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8374843-7d97-45c6-ac77-79bf6b784229 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:17.338599 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8374843-7d97-45c6-ac77-79bf6b784229 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:17.482755 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b8374843-7d97-45c6-ac77-79bf6b784229 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:17.486276 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:17.490856 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b8374843-7d97-45c6-ac77-79bf6b784229 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.167063 Sep 23 14:07:17.495036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 286/577] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:17 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:17.657362 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-157cf40c-8054-41e1-887e-f96c7a6ef198 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:17.657963 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-157cf40c-8054-41e1-887e-f96c7a6ef198 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:17.664616 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-157cf40c-8054-41e1-887e-f96c7a6ef198 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:17.665097 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-157cf40c-8054-41e1-887e-f96c7a6ef198 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:17.665530 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-157cf40c-8054-41e1-887e-f96c7a6ef198 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:17.666207 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-157cf40c-8054-41e1-887e-f96c7a6ef198 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:17.666726 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-157cf40c-8054-41e1-887e-f96c7a6ef198 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:17.667146 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-157cf40c-8054-41e1-887e-f96c7a6ef198 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:17.795242 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-157cf40c-8054-41e1-887e-f96c7a6ef198 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:17.802814 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-157cf40c-8054-41e1-887e-f96c7a6ef198 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.149244 Sep 23 14:07:17.803374 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 287/578] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:17 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:17.808033 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a99c0c42-3830-4321-ab41-4d251cbe8411 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:17.809288 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a99c0c42-3830-4321-ab41-4d251cbe8411 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:17.814764 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a99c0c42-3830-4321-ab41-4d251cbe8411 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:17.815246 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a99c0c42-3830-4321-ab41-4d251cbe8411 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:17.815681 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a99c0c42-3830-4321-ab41-4d251cbe8411 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:17.816358 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a99c0c42-3830-4321-ab41-4d251cbe8411 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:17.816810 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a99c0c42-3830-4321-ab41-4d251cbe8411 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:17.817232 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a99c0c42-3830-4321-ab41-4d251cbe8411 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:17.880226 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a99c0c42-3830-4321-ab41-4d251cbe8411 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:17.888308 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a99c0c42-3830-4321-ab41-4d251cbe8411 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:17.889733 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a99c0c42-3830-4321-ab41-4d251cbe8411 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:17.890982 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a99c0c42-3830-4321-ab41-4d251cbe8411 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1657 microversion: 2.20 time: 0.086440 Sep 23 14:07:17.891538 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 288/579] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:17 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1657 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:18.515080 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6e06c6c6-8bdf-4fc6-804e-492efd30d1c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:18.515721 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6e06c6c6-8bdf-4fc6-804e-492efd30d1c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:18.521716 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e06c6c6-8bdf-4fc6-804e-492efd30d1c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:18.522206 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e06c6c6-8bdf-4fc6-804e-492efd30d1c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:18.522688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e06c6c6-8bdf-4fc6-804e-492efd30d1c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:18.523378 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e06c6c6-8bdf-4fc6-804e-492efd30d1c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:18.523843 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e06c6c6-8bdf-4fc6-804e-492efd30d1c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:18.524267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e06c6c6-8bdf-4fc6-804e-492efd30d1c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:18.656929 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6e06c6c6-8bdf-4fc6-804e-492efd30d1c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:18.664760 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6e06c6c6-8bdf-4fc6-804e-492efd30d1c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.154187 Sep 23 14:07:18.665333 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 289/580] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:18 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:18.826876 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d29d7dd2-be84-4475-8d7f-9357e6f90c1e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:18.827411 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d29d7dd2-be84-4475-8d7f-9357e6f90c1e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:18.833379 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d29d7dd2-be84-4475-8d7f-9357e6f90c1e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:18.835347 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d29d7dd2-be84-4475-8d7f-9357e6f90c1e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:18.835347 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d29d7dd2-be84-4475-8d7f-9357e6f90c1e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:18.835347 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d29d7dd2-be84-4475-8d7f-9357e6f90c1e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:18.835697 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d29d7dd2-be84-4475-8d7f-9357e6f90c1e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:18.836135 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d29d7dd2-be84-4475-8d7f-9357e6f90c1e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:18.968916 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d29d7dd2-be84-4475-8d7f-9357e6f90c1e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:18.976458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d29d7dd2-be84-4475-8d7f-9357e6f90c1e tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.154130 Sep 23 14:07:18.977019 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 290/581] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:18 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:18.981879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-14dbe4b3-def3-4ec1-a287-a84229aca11f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:18.982529 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-14dbe4b3-def3-4ec1-a287-a84229aca11f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:18.987921 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14dbe4b3-def3-4ec1-a287-a84229aca11f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:18.988403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14dbe4b3-def3-4ec1-a287-a84229aca11f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:18.988841 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14dbe4b3-def3-4ec1-a287-a84229aca11f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:18.989525 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14dbe4b3-def3-4ec1-a287-a84229aca11f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:18.989984 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14dbe4b3-def3-4ec1-a287-a84229aca11f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:18.990463 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-14dbe4b3-def3-4ec1-a287-a84229aca11f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:19.055190 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-14dbe4b3-def3-4ec1-a287-a84229aca11f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:19.063850 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-14dbe4b3-def3-4ec1-a287-a84229aca11f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:19.065294 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-14dbe4b3-def3-4ec1-a287-a84229aca11f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:19.066474 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-14dbe4b3-def3-4ec1-a287-a84229aca11f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1366 microversion: 2.20 time: 0.088511 Sep 23 14:07:19.067088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 291/582] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:18 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:19.688239 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-94783464-8fd1-4de0-8fdd-19a6458c3627 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:19.688878 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-94783464-8fd1-4de0-8fdd-19a6458c3627 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:19.694881 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94783464-8fd1-4de0-8fdd-19a6458c3627 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:19.695369 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94783464-8fd1-4de0-8fdd-19a6458c3627 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:19.695827 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94783464-8fd1-4de0-8fdd-19a6458c3627 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:19.696523 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94783464-8fd1-4de0-8fdd-19a6458c3627 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:19.696980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94783464-8fd1-4de0-8fdd-19a6458c3627 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:19.697406 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94783464-8fd1-4de0-8fdd-19a6458c3627 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:19.831457 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-94783464-8fd1-4de0-8fdd-19a6458c3627 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:19.839262 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-94783464-8fd1-4de0-8fdd-19a6458c3627 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.155394 Sep 23 14:07:19.839854 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 292/583] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:19 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:19.999910 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a021f108-5753-42d9-b4e7-b294648b36e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:20.000522 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a021f108-5753-42d9-b4e7-b294648b36e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:20.003625 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:20.007231 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a021f108-5753-42d9-b4e7-b294648b36e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:20.007711 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a021f108-5753-42d9-b4e7-b294648b36e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:20.008137 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a021f108-5753-42d9-b4e7-b294648b36e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:20.008818 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a021f108-5753-42d9-b4e7-b294648b36e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:20.009264 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a021f108-5753-42d9-b4e7-b294648b36e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:20.009688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a021f108-5753-42d9-b4e7-b294648b36e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:20.106151 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4a465f8c-fe79-4075-bcca-8fc934d4dab1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "POST /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.175583 Sep 23 14:07:20.133186 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 292/584] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 23 14:07:15 2022] POST /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-volume_attachments => generated 194 bytes in 4203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:20.140487 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:20.141186 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:20.172192 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:20.179756 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a021f108-5753-42d9-b4e7-b294648b36e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:20.187755 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:20.188664 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:20.190210 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:20.196824 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a021f108-5753-42d9-b4e7-b294648b36e1 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1522 microversion: 2.1 time: 0.194544 Sep 23 14:07:20.196824 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 293/585] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:19 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:20.197062 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:20.197062 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:20.255156 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:20.255981 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:20.256505 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:20.257243 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lazy-loading 'fault' on Instance uuid 97557fbe-c1f4-464e-93b8-3c71fbc48936 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:07:20.286109 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-57a29403-8b72-4e18-93f6-8f1782f016a0 req-f03595af-bb94-42fc-ad99-7a585b0f24c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af91809-ccf1-4b46-8778-e073f385d6ef", "name": "network-vif-deleted", "tag": "2ab6acdc-68c7-4e5c-85c7-bbf6ead5ade9"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:20.301366 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-57a29403-8b72-4e18-93f6-8f1782f016a0 req-f03595af-bb94-42fc-ad99-7a585b0f24c3 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:20.301811 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-57a29403-8b72-4e18-93f6-8f1782f016a0 req-f03595af-bb94-42fc-ad99-7a585b0f24c3 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:20.302249 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-57a29403-8b72-4e18-93f6-8f1782f016a0 req-f03595af-bb94-42fc-ad99-7a585b0f24c3 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:20.316764 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-57a29403-8b72-4e18-93f6-8f1782f016a0 req-f03595af-bb94-42fc-ad99-7a585b0f24c3 service nova] Creating event network-vif-deleted:2ab6acdc-68c7-4e5c-85c7-bbf6ead5ade9 for instance 2af91809-ccf1-4b46-8778-e073f385d6ef on hv-cinder-85743 Sep 23 14:07:20.322002 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-57a29403-8b72-4e18-93f6-8f1782f016a0 req-f03595af-bb94-42fc-ad99-7a585b0f24c3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039356 Sep 23 14:07:20.322996 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 294/586] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:20.351686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:20.362914 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:20.364674 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:20.366106 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-24cb2574-e43c-4b84-bf6b-8c68b13b156a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 200 len: 1371 microversion: 2.20 time: 0.230425 Sep 23 14:07:20.366794 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 293/587] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:20 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:20.864262 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ee43c4f4-7035-45e5-af77-340bd71ae693 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:20.864988 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ee43c4f4-7035-45e5-af77-340bd71ae693 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:20.873655 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee43c4f4-7035-45e5-af77-340bd71ae693 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:20.874129 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee43c4f4-7035-45e5-af77-340bd71ae693 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:20.874597 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee43c4f4-7035-45e5-af77-340bd71ae693 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:20.875284 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee43c4f4-7035-45e5-af77-340bd71ae693 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:20.875741 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee43c4f4-7035-45e5-af77-340bd71ae693 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:20.876168 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee43c4f4-7035-45e5-af77-340bd71ae693 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:21.008618 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ee43c4f4-7035-45e5-af77-340bd71ae693 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:21.016682 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ee43c4f4-7035-45e5-af77-340bd71ae693 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.157174 Sep 23 14:07:21.017457 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 295/588] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:20 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:21.218567 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e1f91b2b-3954-4792-b3df-9282ed5d5c21 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:21.219251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e1f91b2b-3954-4792-b3df-9282ed5d5c21 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:21.225935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e1f91b2b-3954-4792-b3df-9282ed5d5c21 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:21.226465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e1f91b2b-3954-4792-b3df-9282ed5d5c21 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:21.226905 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e1f91b2b-3954-4792-b3df-9282ed5d5c21 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:21.227594 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e1f91b2b-3954-4792-b3df-9282ed5d5c21 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:21.228070 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e1f91b2b-3954-4792-b3df-9282ed5d5c21 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:21.228517 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e1f91b2b-3954-4792-b3df-9282ed5d5c21 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:21.260692 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e1f91b2b-3954-4792-b3df-9282ed5d5c21 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:21.261171 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e1f91b2b-3954-4792-b3df-9282ed5d5c21 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:21.261603 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e1f91b2b-3954-4792-b3df-9282ed5d5c21 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:21.262671 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-e1f91b2b-3954-4792-b3df-9282ed5d5c21 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lazy-loading 'fault' on Instance uuid 2af91809-ccf1-4b46-8778-e073f385d6ef {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:07:21.302138 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e1f91b2b-3954-4792-b3df-9282ed5d5c21 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b64a35d7b44519a1d93919f2e23083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08a219027684089a91c354749c67d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:21.311327 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e1f91b2b-3954-4792-b3df-9282ed5d5c21 tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 200 len: 1312 microversion: 2.1 time: 0.096629 Sep 23 14:07:21.311897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 294/589] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:21 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:21.394293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4bc211f3-b501-4197-b99f-540761bdc7f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:21.395173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4bc211f3-b501-4197-b99f-540761bdc7f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:21.401281 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4bc211f3-b501-4197-b99f-540761bdc7f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:21.401759 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4bc211f3-b501-4197-b99f-540761bdc7f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:21.402188 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4bc211f3-b501-4197-b99f-540761bdc7f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:21.402983 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4bc211f3-b501-4197-b99f-540761bdc7f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:21.403428 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4bc211f3-b501-4197-b99f-540761bdc7f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:21.413584 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4bc211f3-b501-4197-b99f-540761bdc7f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:21.416873 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-4bc211f3-b501-4197-b99f-540761bdc7f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] HTTP exception thrown: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4bc211f3-b501-4197-b99f-540761bdc7f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Request method failure captured: Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 HTTP/1.1 Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbzD5tcLB7ojLK9sr1C8_DBx43QfyeN7NeFu7YWTgc9cqtaWAuzwgcRnelGs9UVBOqmlLHHFjXsUUof6q-DBOazO4tZAPYT1KymIaJYtWPTehkSBtOvXp-5qmhIOecgRwOuGBsgkkh_mpkl_QdwgDodLMUSm2yeDbcRFg4GTEvC_IxQ Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: c21d140d48ba4014bc470e8cf720785d Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:07:21.419089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:07:21.420754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c21d140d48ba4014bc470e8cf720785d"}]}] Sep 23 14:07:21.420754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:07:21.420754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: c21d140d48ba4014bc470e8cf720785d Sep 23 14:07:21.420754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:07:21.420754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-AttachVolumeShelveTestJSON-1453461522-project Sep 23 14:07:21.420754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:07:21.420754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:07:21.420754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: d777c43fe5c142b3b5ea5e2485f4e49f Sep 23 14:07:21.420754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1453461522-project Sep 23 14:07:21.420754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:07:21.420754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:07:21.420754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': '97557fbe-c1f4-464e-93b8-3c71fbc48936'} Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:07:21.421630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:07:21.423257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:21.424543 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4bc211f3-b501-4197-b99f-540761bdc7f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Returning 404 to user: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:07:21.424543 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4bc211f3-b501-4197-b99f-540761bdc7f6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 404 len: 111 microversion: 2.20 time: 0.031491 Sep 23 14:07:21.424543 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 296/590] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:21 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 14:07:21.431237 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8bb3e1af-82d8-451b-b392-444371c96a73 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '.version_select at 0x7f9083a58ca0>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:21.511656 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8bb3e1af-82d8-451b-b392-444371c96a73 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836884531" status: 204 len: 0 microversion: 2.20 time: 0.085843 Sep 23 14:07:21.512350 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 295/591] 10.222.0.62 () {60 vars in 1262 bytes} [Fri Sep 23 14:07:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836884531 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 14:07:22.038783 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4923e043-04e0-4431-be91-85a9acbd93ff tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:22.039392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4923e043-04e0-4431-be91-85a9acbd93ff tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:22.045551 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4923e043-04e0-4431-be91-85a9acbd93ff tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:22.046310 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4923e043-04e0-4431-be91-85a9acbd93ff tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:22.046577 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4923e043-04e0-4431-be91-85a9acbd93ff tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:22.047268 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4923e043-04e0-4431-be91-85a9acbd93ff tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:22.047717 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4923e043-04e0-4431-be91-85a9acbd93ff tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:22.048143 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4923e043-04e0-4431-be91-85a9acbd93ff tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:22.187186 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4923e043-04e0-4431-be91-85a9acbd93ff tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:22.194785 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4923e043-04e0-4431-be91-85a9acbd93ff tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.159814 Sep 23 14:07:22.195270 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 297/592] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:22 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:22.329694 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6702e8c8-9d6a-4f60-abdb-2516b8896954 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Action: 'create', calling method: .version_select at 0x7f9083ab00d0>, body: {"keypair": {"name": "tempest-keypair-67753299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdydV+WxvTX/QkE0ZtP9lQAlw310p23v6a6SX9FbVDKNhpsxK2xVwYhww70t1brSX/uRAuJOTnKSTEVYY5H4I85c3KPTpPpwW7ws7xo8ov/q2AYOJ/IZHVlBDqRzGyUow=="}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:22.334367 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b9cd01c0-dd97-4531-9170-a136cd1daefc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:22.334976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b9cd01c0-dd97-4531-9170-a136cd1daefc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] [instance: 2af91809-ccf1-4b46-8778-e073f385d6ef] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:22.341059 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b9cd01c0-dd97-4531-9170-a136cd1daefc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:22.341549 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b9cd01c0-dd97-4531-9170-a136cd1daefc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:22.341984 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b9cd01c0-dd97-4531-9170-a136cd1daefc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:22.342762 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b9cd01c0-dd97-4531-9170-a136cd1daefc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:22.343215 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b9cd01c0-dd97-4531-9170-a136cd1daefc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:22.343634 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b9cd01c0-dd97-4531-9170-a136cd1daefc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:22.345928 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-6702e8c8-9d6a-4f60-abdb-2516b8896954 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Getting quotas for project c21d140d48ba4014bc470e8cf720785d. Resources: {'key_pairs'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:07:22.349811 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-6702e8c8-9d6a-4f60-abdb-2516b8896954 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Getting quotas for user d777c43fe5c142b3b5ea5e2485f4e49f and project c21d140d48ba4014bc470e8cf720785d. Resources: {'key_pairs'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:07:22.357710 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-b9cd01c0-dd97-4531-9170-a136cd1daefc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] HTTP exception thrown: Instance 2af91809-ccf1-4b46-8778-e073f385d6ef could not be found. Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b9cd01c0-dd97-4531-9170-a136cd1daefc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Request method failure captured: Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef HTTP/1.1 Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxnzDm6DgW0nTYDFDzi5SOHvSPJ6hZrF_pz9Ph0XCziqGU45FO9Ids8cW2I9WFrbXMdkl7DdqmLLFpEppSALkiMXJRcKEd-oKGJ1eeg29_bry9MG0PBEvVfdfr6Lqo4PU_2dBPb3P4fhNFCVeOEEyfkxVL-v3y86ZS4kPvYsqdra7o Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: d08a219027684089a91c354749c67d5d Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:07:22.359263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:07:22.360663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d08a219027684089a91c354749c67d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d08a219027684089a91c354749c67d5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d08a219027684089a91c354749c67d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d08a219027684089a91c354749c67d5d"}]}] Sep 23 14:07:22.360663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:07:22.360663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: d08a219027684089a91c354749c67d5d Sep 23 14:07:22.360663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1299274290 Sep 23 14:07:22.360663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-ServerRescueNegativeTestJSON-1299274290-project Sep 23 14:07:22.360663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:07:22.360663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:07:22.360663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 28b64a35d7b44519a1d93919f2e23083 Sep 23 14:07:22.360663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1299274290-project Sep 23 14:07:22.360663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:07:22.360663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance 2af91809-ccf1-4b46-8778-e073f385d6ef could not be found. Sep 23 14:07:22.360663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': '2af91809-ccf1-4b46-8778-e073f385d6ef'} Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2af91809-ccf1-4b46-8778-e073f385d6ef could not be found. Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:07:22.361424 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2af91809-ccf1-4b46-8778-e073f385d6ef could not be found. Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2af91809-ccf1-4b46-8778-e073f385d6ef could not be found. Sep 23 14:07:22.362695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:22.364248 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b9cd01c0-dd97-4531-9170-a136cd1daefc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] Returning 404 to user: Instance 2af91809-ccf1-4b46-8778-e073f385d6ef could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:07:22.364248 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b9cd01c0-dd97-4531-9170-a136cd1daefc tempest-ServerRescueNegativeTestJSON-1299274290 tempest-ServerRescueNegativeTestJSON-1299274290-project] 10.222.0.62 "GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef" status: 404 len: 111 microversion: 2.1 time: 0.030039 Sep 23 14:07:22.364248 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 298/593] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:22 2022] GET /compute/v2.1/servers/2af91809-ccf1-4b46-8778-e073f385d6ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 14:07:22.459307 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-6702e8c8-9d6a-4f60-abdb-2516b8896954 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.134109 Sep 23 14:07:22.460119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 296/594] 10.222.0.62 () {62 vars in 1200 bytes} [Fri Sep 23 14:07:22 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 14:07:23.217439 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-246ae5c1-fa0d-4527-b1c2-b0598e1323a2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:23.220247 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-246ae5c1-fa0d-4527-b1c2-b0598e1323a2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:23.226362 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-246ae5c1-fa0d-4527-b1c2-b0598e1323a2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:23.226846 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-246ae5c1-fa0d-4527-b1c2-b0598e1323a2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:23.227477 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-246ae5c1-fa0d-4527-b1c2-b0598e1323a2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:23.228166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-246ae5c1-fa0d-4527-b1c2-b0598e1323a2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:23.228621 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-246ae5c1-fa0d-4527-b1c2-b0598e1323a2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:23.229047 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-246ae5c1-fa0d-4527-b1c2-b0598e1323a2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:23.366798 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-246ae5c1-fa0d-4527-b1c2-b0598e1323a2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:23.376978 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-246ae5c1-fa0d-4527-b1c2-b0598e1323a2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.163080 Sep 23 14:07:23.390120 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 299/595] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:23 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:24.399763 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ad6d1738-135d-41cb-9460-185bd502f425 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:24.400280 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ad6d1738-135d-41cb-9460-185bd502f425 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:24.406711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad6d1738-135d-41cb-9460-185bd502f425 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:24.407199 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad6d1738-135d-41cb-9460-185bd502f425 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:24.407639 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad6d1738-135d-41cb-9460-185bd502f425 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:24.408336 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad6d1738-135d-41cb-9460-185bd502f425 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:24.408787 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad6d1738-135d-41cb-9460-185bd502f425 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:24.409207 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad6d1738-135d-41cb-9460-185bd502f425 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:24.588908 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ad6d1738-135d-41cb-9460-185bd502f425 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:24.597902 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ad6d1738-135d-41cb-9460-185bd502f425 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.202843 Sep 23 14:07:24.598805 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 297/596] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:24 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:24.879753 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-ae51db75-a738-4613-8e57-4e0967e4c588 req-3c002ed7-b720-4995-8cc4-324765688b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817ae959-3342-4926-9f60-e4a24124a282", "name": "network-vif-plugged", "status": "completed", "tag": "c3a78cda-14d8-495c-98ba-ab806fda32b8"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:24.893317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-ae51db75-a738-4613-8e57-4e0967e4c588 req-3c002ed7-b720-4995-8cc4-324765688b3d service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:24.893929 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-ae51db75-a738-4613-8e57-4e0967e4c588 req-3c002ed7-b720-4995-8cc4-324765688b3d service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:24.895324 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-ae51db75-a738-4613-8e57-4e0967e4c588 req-3c002ed7-b720-4995-8cc4-324765688b3d service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:24.909957 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-ae51db75-a738-4613-8e57-4e0967e4c588 req-3c002ed7-b720-4995-8cc4-324765688b3d service nova] Creating event network-vif-plugged:c3a78cda-14d8-495c-98ba-ab806fda32b8 for instance 817ae959-3342-4926-9f60-e4a24124a282 on hv-cinder-85743 Sep 23 14:07:24.914928 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-ae51db75-a738-4613-8e57-4e0967e4c588 req-3c002ed7-b720-4995-8cc4-324765688b3d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040594 Sep 23 14:07:24.915974 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 300/597] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:25.333895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1328421606", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f2b1efa-9c49-4c4b-95ca-efb64f014785"}], "security_groups": [{"name": "tempest-securitygroup--1433301092"}], "key_name": "tempest-keypair-67753299", "user_data": "}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:25.446544 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.network.neutron [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] validate_networks() for [('0f2b1efa-9c49-4c4b-95ca-efb64f014785', None, None, None, None, None)] {{(pid=121073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:07:25.623100 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-02ae3ddf-65b1-4aba-96d7-a31988550201 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:25.624066 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-02ae3ddf-65b1-4aba-96d7-a31988550201 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:25.631042 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-02ae3ddf-65b1-4aba-96d7-a31988550201 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:25.631822 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-02ae3ddf-65b1-4aba-96d7-a31988550201 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:25.632267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-02ae3ddf-65b1-4aba-96d7-a31988550201 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:25.632969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-02ae3ddf-65b1-4aba-96d7-a31988550201 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:25.633606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-02ae3ddf-65b1-4aba-96d7-a31988550201 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:25.634043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-02ae3ddf-65b1-4aba-96d7-a31988550201 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:25.906631 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-02ae3ddf-65b1-4aba-96d7-a31988550201 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:25.919144 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-02ae3ddf-65b1-4aba-96d7-a31988550201 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.301117 Sep 23 14:07:25.920024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 301/598] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:25 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:26.021686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Flavor limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:07:26.022114 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Image limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:07:26.022629 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Flavor pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:07:26.023037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Image pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:07:26.023518 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:07:26.032724 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:26.033216 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:26.033670 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:26.034450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:26.034905 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:26.037784 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:26.053309 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Getting quotas for project c21d140d48ba4014bc470e8cf720785d. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:07:26.058214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Getting quotas for user d777c43fe5c142b3b5ea5e2485f4e49f and project c21d140d48ba4014bc470e8cf720785d. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:07:26.070420 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Going to run 1 instances... {{(pid=121073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:07:26.072711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:07:26.221473 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3e608652-4f7f-4d17-93b5-e55eb3103c3c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.891751 Sep 23 14:07:26.222433 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 298/599] 10.222.0.62 () {62 vars in 1188 bytes} [Fri Sep 23 14:07:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 14:07:26.236998 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-835dd901-777a-40d5-b2df-ec172b78b3f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:26.237639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-835dd901-777a-40d5-b2df-ec172b78b3f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:26.317904 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-835dd901-777a-40d5-b2df-ec172b78b3f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:26.326981 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-835dd901-777a-40d5-b2df-ec172b78b3f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:26.328613 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-835dd901-777a-40d5-b2df-ec172b78b3f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:26.329793 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-835dd901-777a-40d5-b2df-ec172b78b3f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1280 microversion: 2.20 time: 0.099685 Sep 23 14:07:26.330612 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 302/600] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:26 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:26.945953 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9e473f56-7dbd-4fa9-be07-e098894dad37 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:26.947199 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9e473f56-7dbd-4fa9-be07-e098894dad37 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:26.962078 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9e473f56-7dbd-4fa9-be07-e098894dad37 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:26.964649 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9e473f56-7dbd-4fa9-be07-e098894dad37 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:26.964649 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9e473f56-7dbd-4fa9-be07-e098894dad37 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:26.965093 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9e473f56-7dbd-4fa9-be07-e098894dad37 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:26.966125 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9e473f56-7dbd-4fa9-be07-e098894dad37 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:26.966776 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9e473f56-7dbd-4fa9-be07-e098894dad37 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:27.161943 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9e473f56-7dbd-4fa9-be07-e098894dad37 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:27.170544 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9e473f56-7dbd-4fa9-be07-e098894dad37 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1266 microversion: 2.1 time: 0.231460 Sep 23 14:07:27.171127 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 299/601] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:26 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:27.356499 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6c555c81-08f4-41e1-8162-f282fda72461 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:27.357129 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6c555c81-08f4-41e1-8162-f282fda72461 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:27.364037 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6c555c81-08f4-41e1-8162-f282fda72461 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:27.364532 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6c555c81-08f4-41e1-8162-f282fda72461 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:27.364975 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6c555c81-08f4-41e1-8162-f282fda72461 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:27.365671 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6c555c81-08f4-41e1-8162-f282fda72461 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:27.366134 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6c555c81-08f4-41e1-8162-f282fda72461 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:27.366639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6c555c81-08f4-41e1-8162-f282fda72461 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:27.427696 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6c555c81-08f4-41e1-8162-f282fda72461 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:27.436570 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6c555c81-08f4-41e1-8162-f282fda72461 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:27.438032 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6c555c81-08f4-41e1-8162-f282fda72461 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:27.439194 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6c555c81-08f4-41e1-8162-f282fda72461 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1284 microversion: 2.20 time: 0.087446 Sep 23 14:07:27.442647 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 303/602] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:27 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:28.192930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5e05bfc7-e4f0-4c4f-80f9-f830322afab4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:28.193591 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5e05bfc7-e4f0-4c4f-80f9-f830322afab4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:28.204274 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e05bfc7-e4f0-4c4f-80f9-f830322afab4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:28.204768 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e05bfc7-e4f0-4c4f-80f9-f830322afab4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:28.205476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e05bfc7-e4f0-4c4f-80f9-f830322afab4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:28.206517 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e05bfc7-e4f0-4c4f-80f9-f830322afab4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:28.207121 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e05bfc7-e4f0-4c4f-80f9-f830322afab4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:28.207615 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e05bfc7-e4f0-4c4f-80f9-f830322afab4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:28.359175 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5e05bfc7-e4f0-4c4f-80f9-f830322afab4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:28.369386 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5e05bfc7-e4f0-4c4f-80f9-f830322afab4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1453 microversion: 2.1 time: 0.180251 Sep 23 14:07:28.371629 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 300/603] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:28 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1453 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:28.398649 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-04d47eb9-b9de-4ec8-9bb0-0b20bae4d03a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:28.399211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-04d47eb9-b9de-4ec8-9bb0-0b20bae4d03a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:28.405430 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04d47eb9-b9de-4ec8-9bb0-0b20bae4d03a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:28.409733 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04d47eb9-b9de-4ec8-9bb0-0b20bae4d03a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:28.409733 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04d47eb9-b9de-4ec8-9bb0-0b20bae4d03a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:28.409733 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04d47eb9-b9de-4ec8-9bb0-0b20bae4d03a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:28.409733 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04d47eb9-b9de-4ec8-9bb0-0b20bae4d03a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:28.410087 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04d47eb9-b9de-4ec8-9bb0-0b20bae4d03a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:28.464739 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-542b0532-1ccc-419b-829d-59de675be1cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:28.466494 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-542b0532-1ccc-419b-829d-59de675be1cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:28.473272 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-542b0532-1ccc-419b-829d-59de675be1cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:28.474101 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-542b0532-1ccc-419b-829d-59de675be1cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:28.474781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-542b0532-1ccc-419b-829d-59de675be1cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:28.475670 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-542b0532-1ccc-419b-829d-59de675be1cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:28.476307 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-542b0532-1ccc-419b-829d-59de675be1cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:28.476939 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-542b0532-1ccc-419b-829d-59de675be1cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:28.569781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-542b0532-1ccc-419b-829d-59de675be1cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:28.578556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-542b0532-1ccc-419b-829d-59de675be1cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:28.580000 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-542b0532-1ccc-419b-829d-59de675be1cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:28.581105 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-542b0532-1ccc-419b-829d-59de675be1cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1332 microversion: 2.20 time: 0.120555 Sep 23 14:07:28.581665 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 301/604] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:28 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:07:28.603758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-04d47eb9-b9de-4ec8-9bb0-0b20bae4d03a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:28.612522 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-04d47eb9-b9de-4ec8-9bb0-0b20bae4d03a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1453 microversion: 2.1 time: 0.218046 Sep 23 14:07:28.613085 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 304/605] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:28 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1453 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:29.118253 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6b47cf62-d0ed-4c85-8cfc-2d709f1e786e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f45ddfea-b90d-4971-b1db-42c5f121b704"}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:29.121018 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6b47cf62-d0ed-4c85-8cfc-2d709f1e786e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:29.128917 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b47cf62-d0ed-4c85-8cfc-2d709f1e786e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:29.129404 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b47cf62-d0ed-4c85-8cfc-2d709f1e786e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:29.129835 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b47cf62-d0ed-4c85-8cfc-2d709f1e786e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:29.130974 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b47cf62-d0ed-4c85-8cfc-2d709f1e786e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:29.132103 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b47cf62-d0ed-4c85-8cfc-2d709f1e786e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:29.132688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b47cf62-d0ed-4c85-8cfc-2d709f1e786e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:29.159676 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-0cda227d-c41b-43b1-84e8-f7af0a781be5 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Action: 'create', calling method: .version_select at 0x7f9083a72160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-807047439"}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:29.242090 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-6b47cf62-d0ed-4c85-8cfc-2d709f1e786e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] HTTP exception thrown: Invalid volume: volume f45ddfea-b90d-4971-b1db-42c5f121b704 is already attached to instances: eee99559-a86f-4088-9fd1-a6ae97245d92 Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6b47cf62-d0ed-4c85-8cfc-2d709f1e786e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Request method failure captured: Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: POST /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-volume_attachments HTTP/1.1 Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 74 Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxrzANyu0HiE-RI6YrwV4d8fV10ylWEIATegCXV8WUB95m5oAKUEypeFaRSmFIPzbJ8OQMl6Aud1_-7wjU4ZO6GDRxJPylRi9sW9fsJGE2eeMrNRP5hVeqDi3IdZCENn82q0KEmt_9wVferpVh22qvGQNXZFPNp1vMViuNoGirJUN4 Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:07:29.244079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:07:29.245381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_482490c45ac64607bba9ad021f2effbf"}]}] Sep 23 14:07:29.245381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:07:29.245381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:07:29.245381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:07:29.245381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:07:29.245381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:07:29.245381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:07:29.245381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 0db30f990aae49fabf9b8b19cd019de9 Sep 23 14:07:29.245381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:07:29.245381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Sep 23 14:07:29.245381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {"volumeAttachment": {"volumeId": "f45ddfea-b90d-4971-b1db-42c5f121b704"}} Sep 23 14:07:29.245381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Invalid volume: volume f45ddfea-b90d-4971-b1db-42c5f121b704 is already attached to instances: eee99559-a86f-4088-9fd1-a6ae97245d92 Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'server_id': 'eee99559-a86f-4088-9fd1-a6ae97245d92', 'body': {'volumeAttachment': {'volumeId': 'f45ddfea-b90d-4971-b1db-42c5f121b704'}}} Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f45ddfea-b90d-4971-b1db-42c5f121b704 is already attached to instances: eee99559-a86f-4088-9fd1-a6ae97245d92 Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:29.246173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f45ddfea-b90d-4971-b1db-42c5f121b704 is already attached to instances: eee99559-a86f-4088-9fd1-a6ae97245d92 Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:29.248258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:29.249791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:29.249791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:07:29.249791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:07:29.249791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f45ddfea-b90d-4971-b1db-42c5f121b704 is already attached to instances: eee99559-a86f-4088-9fd1-a6ae97245d92 Sep 23 14:07:29.249791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:29.249791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6b47cf62-d0ed-4c85-8cfc-2d709f1e786e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Returning 400 to user: Invalid volume: volume f45ddfea-b90d-4971-b1db-42c5f121b704 is already attached to instances: eee99559-a86f-4088-9fd1-a6ae97245d92 {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:07:29.249791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6b47cf62-d0ed-4c85-8cfc-2d709f1e786e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "POST /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.132172 Sep 23 14:07:29.249791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 305/606] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 23 14:07:29 2022] POST /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-volume_attachments => generated 174 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 14:07:29.322178 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-3cef66b1-b896-4e17-8e83-4ea9959d6d0a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:29.334045 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-3cef66b1-b896-4e17-8e83-4ea9959d6d0a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:29.334045 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3cef66b1-b896-4e17-8e83-4ea9959d6d0a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:29.334045 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3cef66b1-b896-4e17-8e83-4ea9959d6d0a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:29.334045 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3cef66b1-b896-4e17-8e83-4ea9959d6d0a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:29.334720 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3cef66b1-b896-4e17-8e83-4ea9959d6d0a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:29.334720 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3cef66b1-b896-4e17-8e83-4ea9959d6d0a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:29.334720 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3cef66b1-b896-4e17-8e83-4ea9959d6d0a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:29.437646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-3cef66b1-b896-4e17-8e83-4ea9959d6d0a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lazy-loading 'services' on Instance uuid eee99559-a86f-4088-9fd1-a6ae97245d92 {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:07:29.441272 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=100 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:29.692465 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-3cef66b1-b896-4e17-8e83-4ea9959d6d0a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-volume_attachments/f45ddfea-b90d-4971-b1db-42c5f121b704" status: 202 len: 0 microversion: 2.1 time: 0.374158 Sep 23 14:07:29.693285 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 306/607] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 23 14:07:29 2022] DELETE /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-volume_attachments/f45ddfea-b90d-4971-b1db-42c5f121b704 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 14:07:29.699479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6e2c3a76-654d-4069-a003-577073515bde tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:29.701384 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6e2c3a76-654d-4069-a003-577073515bde tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:29.707848 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e2c3a76-654d-4069-a003-577073515bde tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:29.708342 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e2c3a76-654d-4069-a003-577073515bde tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:29.708876 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e2c3a76-654d-4069-a003-577073515bde tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:29.709584 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e2c3a76-654d-4069-a003-577073515bde tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:29.710047 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e2c3a76-654d-4069-a003-577073515bde tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:29.710506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e2c3a76-654d-4069-a003-577073515bde tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:29.793569 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6e2c3a76-654d-4069-a003-577073515bde tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:29.802763 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6e2c3a76-654d-4069-a003-577073515bde tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:29.804466 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6e2c3a76-654d-4069-a003-577073515bde tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:29.805588 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6e2c3a76-654d-4069-a003-577073515bde tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1338 microversion: 2.20 time: 0.110821 Sep 23 14:07:29.806146 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 307/608] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:29 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:29.823128 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-40cde09e-5ba4-4150-8b84-91acc6a647b9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:29.826079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-40cde09e-5ba4-4150-8b84-91acc6a647b9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:29.832108 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-40cde09e-5ba4-4150-8b84-91acc6a647b9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:29.832600 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-40cde09e-5ba4-4150-8b84-91acc6a647b9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:29.833039 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-40cde09e-5ba4-4150-8b84-91acc6a647b9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:29.833734 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-40cde09e-5ba4-4150-8b84-91acc6a647b9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:29.834197 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-40cde09e-5ba4-4150-8b84-91acc6a647b9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:29.834657 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-40cde09e-5ba4-4150-8b84-91acc6a647b9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:29.865190 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-40cde09e-5ba4-4150-8b84-91acc6a647b9 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057877 Sep 23 14:07:29.865759 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 308/609] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:07:29 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:30.072352 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-0cda227d-c41b-43b1-84e8-f7af0a781be5 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.076343 Sep 23 14:07:30.073492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 302/610] 10.222.0.62 () {60 vars in 1155 bytes} [Fri Sep 23 14:07:28 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1078 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 23 14:07:30.088305 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1784fd41-c061-43c0-8678-cae0d3d4188a tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083dab8b0>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:30.144882 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1784fd41-c061-43c0-8678-cae0d3d4188a tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae" status: 200 len: 344 microversion: 2.1 time: 0.061229 Sep 23 14:07:30.145583 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 309/611] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 23 14:07:30 2022] GET /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:30.835613 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-08d41a4b-3ec6-4da3-b7f7-8158289edfcc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:30.837632 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-08d41a4b-3ec6-4da3-b7f7-8158289edfcc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:30.845636 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-08d41a4b-3ec6-4da3-b7f7-8158289edfcc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:30.846259 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-08d41a4b-3ec6-4da3-b7f7-8158289edfcc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:30.846864 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-08d41a4b-3ec6-4da3-b7f7-8158289edfcc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:30.847876 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-08d41a4b-3ec6-4da3-b7f7-8158289edfcc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:30.848600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-08d41a4b-3ec6-4da3-b7f7-8158289edfcc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:30.849247 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-08d41a4b-3ec6-4da3-b7f7-8158289edfcc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:30.879634 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-955d2d9f-2a5e-4b7e-a94b-5e6153aeb5b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:30.882517 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-955d2d9f-2a5e-4b7e-a94b-5e6153aeb5b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:30.901153 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-955d2d9f-2a5e-4b7e-a94b-5e6153aeb5b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:30.907413 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-955d2d9f-2a5e-4b7e-a94b-5e6153aeb5b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:30.907413 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-955d2d9f-2a5e-4b7e-a94b-5e6153aeb5b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:30.907413 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-955d2d9f-2a5e-4b7e-a94b-5e6153aeb5b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:30.907413 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-955d2d9f-2a5e-4b7e-a94b-5e6153aeb5b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:30.907820 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-955d2d9f-2a5e-4b7e-a94b-5e6153aeb5b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:30.938660 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-955d2d9f-2a5e-4b7e-a94b-5e6153aeb5b2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064006 Sep 23 14:07:30.939393 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 310/612] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:07:30 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:31.088144 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-08d41a4b-3ec6-4da3-b7f7-8158289edfcc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:31.096602 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-08d41a4b-3ec6-4da3-b7f7-8158289edfcc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:31.099042 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-08d41a4b-3ec6-4da3-b7f7-8158289edfcc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:31.100178 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-08d41a4b-3ec6-4da3-b7f7-8158289edfcc tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1406 microversion: 2.20 time: 0.272790 Sep 23 14:07:31.100743 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 303/613] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:30 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:31.151361 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-02a249e8-3e2e-403e-815a-22596f17d18b req-da96a759-ff7b-4a75-a32f-28efb9b03f49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c49eff20-f8a6-404b-b09c-def6e4c167ca", "tag": "20043706-94ae-416a-96d1-e1f2fc14183b"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:31.159413 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-579f6795-742a-4d23-aa2c-9c42023c1237 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083a58820>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:31.167622 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-02a249e8-3e2e-403e-815a-22596f17d18b req-da96a759-ff7b-4a75-a32f-28efb9b03f49 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:31.168373 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-02a249e8-3e2e-403e-815a-22596f17d18b req-da96a759-ff7b-4a75-a32f-28efb9b03f49 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:31.170402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-02a249e8-3e2e-403e-815a-22596f17d18b req-da96a759-ff7b-4a75-a32f-28efb9b03f49 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:31.182983 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-02a249e8-3e2e-403e-815a-22596f17d18b req-da96a759-ff7b-4a75-a32f-28efb9b03f49 service nova] Creating event network-changed:20043706-94ae-416a-96d1-e1f2fc14183b for instance c49eff20-f8a6-404b-b09c-def6e4c167ca on hv-cinder-85743 Sep 23 14:07:31.189558 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-02a249e8-3e2e-403e-815a-22596f17d18b req-da96a759-ff7b-4a75-a32f-28efb9b03f49 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042964 Sep 23 14:07:31.190834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 311/614] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:07:31.234321 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-579f6795-742a-4d23-aa2c-9c42023c1237 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae" status: 200 len: 345 microversion: 2.1 time: 0.078659 Sep 23 14:07:31.234934 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 304/615] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 23 14:07:31 2022] GET /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:07:31.254471 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-235b51c9-0758-47f9-bec5-7dec4fa1cc51 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Action: 'create', calling method: .version_select at 0x7f9083bd1d30>, body: {"snapshot": {"volume_id": "7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-426036767"}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:31.282038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-2568db53-dcf2-49a2-b9df-5b45c2e6c3b9 req-4658b43e-83e6-4361-afab-c908c70a4d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817ae959-3342-4926-9f60-e4a24124a282", "tag": "c3a78cda-14d8-495c-98ba-ab806fda32b8"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:31.302406 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2568db53-dcf2-49a2-b9df-5b45c2e6c3b9 req-4658b43e-83e6-4361-afab-c908c70a4d39 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:31.302894 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2568db53-dcf2-49a2-b9df-5b45c2e6c3b9 req-4658b43e-83e6-4361-afab-c908c70a4d39 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:31.303329 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2568db53-dcf2-49a2-b9df-5b45c2e6c3b9 req-4658b43e-83e6-4361-afab-c908c70a4d39 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:31.334168 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-2568db53-dcf2-49a2-b9df-5b45c2e6c3b9 req-4658b43e-83e6-4361-afab-c908c70a4d39 service nova] Creating event network-changed:c3a78cda-14d8-495c-98ba-ab806fda32b8 for instance 817ae959-3342-4926-9f60-e4a24124a282 on hv-cinder-85743 Sep 23 14:07:31.342049 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-2568db53-dcf2-49a2-b9df-5b45c2e6c3b9 req-4658b43e-83e6-4361-afab-c908c70a4d39 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064280 Sep 23 14:07:31.352022 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 305/616] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:31.857666 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-235b51c9-0758-47f9-bec5-7dec4fa1cc51 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.612628 Sep 23 14:07:31.858984 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 312/617] 10.222.0.62 () {60 vars in 1162 bytes} [Fri Sep 23 14:07:31 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:31.872810 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b8b73711-776e-4b41-b0b9-1af9219ac532 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083ac2700>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:31.916689 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b8b73711-776e-4b41-b0b9-1af9219ac532 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800" status: 200 len: 286 microversion: 2.1 time: 0.049013 Sep 23 14:07:31.917478 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 306/618] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 23 14:07:31 2022] GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:31.928820 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-cefd7755-ca2f-4359-8eeb-af7e47e391b9 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083f17a60>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:31.952512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3569ab76-ea59-46f9-92fc-0016eaa00d5a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:31.958985 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3569ab76-ea59-46f9-92fc-0016eaa00d5a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:31.978595 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3569ab76-ea59-46f9-92fc-0016eaa00d5a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:31.981019 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3569ab76-ea59-46f9-92fc-0016eaa00d5a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:31.981138 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-cefd7755-ca2f-4359-8eeb-af7e47e391b9 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.054515 Sep 23 14:07:31.981238 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3569ab76-ea59-46f9-92fc-0016eaa00d5a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:31.981328 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 313/619] 10.222.0.62 () {58 vars in 1140 bytes} [Fri Sep 23 14:07:31 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:31.981410 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3569ab76-ea59-46f9-92fc-0016eaa00d5a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:31.981845 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3569ab76-ea59-46f9-92fc-0016eaa00d5a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:31.982463 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3569ab76-ea59-46f9-92fc-0016eaa00d5a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:31.992272 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ff5f5355-2fd4-4617-b18d-05bb759c76ff tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083bec940>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:32.025976 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3569ab76-ea59-46f9-92fc-0016eaa00d5a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078250 Sep 23 14:07:32.032515 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 307/620] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:07:31 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 14:07:32.044709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ff5f5355-2fd4-4617-b18d-05bb759c76ff tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800" status: 200 len: 286 microversion: 2.1 time: 0.052239 Sep 23 14:07:32.044709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 314/621] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 23 14:07:31 2022] GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:07:32.108525 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-7873750f-12d6-48d5-8d99-558ee3152831 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:32.108525 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-7873750f-12d6-48d5-8d99-558ee3152831 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:32.115300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7873750f-12d6-48d5-8d99-558ee3152831 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:32.115885 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7873750f-12d6-48d5-8d99-558ee3152831 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:32.116384 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7873750f-12d6-48d5-8d99-558ee3152831 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:32.117227 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7873750f-12d6-48d5-8d99-558ee3152831 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:32.117757 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7873750f-12d6-48d5-8d99-558ee3152831 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:32.120196 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7873750f-12d6-48d5-8d99-558ee3152831 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:32.125293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8a144195-ceb0-46fe-9f89-30278599dcd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:32.126032 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8a144195-ceb0-46fe-9f89-30278599dcd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:32.133843 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8a144195-ceb0-46fe-9f89-30278599dcd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:32.134370 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8a144195-ceb0-46fe-9f89-30278599dcd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:32.134827 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8a144195-ceb0-46fe-9f89-30278599dcd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:32.135543 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8a144195-ceb0-46fe-9f89-30278599dcd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:32.136003 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8a144195-ceb0-46fe-9f89-30278599dcd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:32.136440 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8a144195-ceb0-46fe-9f89-30278599dcd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:32.151794 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-7873750f-12d6-48d5-8d99-558ee3152831 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Going to try to terminate instance {{(pid=121073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:07:32.305690 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8a144195-ceb0-46fe-9f89-30278599dcd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:32.314894 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8a144195-ceb0-46fe-9f89-30278599dcd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:32.316266 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8a144195-ceb0-46fe-9f89-30278599dcd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:32.317374 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8a144195-ceb0-46fe-9f89-30278599dcd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1406 microversion: 2.20 time: 0.196330 Sep 23 14:07:32.317935 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 315/622] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:32 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:32.459998 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-7873750f-12d6-48d5-8d99-558ee3152831 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 204 len: 0 microversion: 2.1 time: 0.355638 Sep 23 14:07:32.460684 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 308/623] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:07:32 2022] DELETE /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:07:32.469031 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-aae65afb-8c95-4ef8-af96-0764a3debb4c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:32.469817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-aae65afb-8c95-4ef8-af96-0764a3debb4c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:32.475869 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aae65afb-8c95-4ef8-af96-0764a3debb4c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:32.477142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aae65afb-8c95-4ef8-af96-0764a3debb4c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:32.477142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aae65afb-8c95-4ef8-af96-0764a3debb4c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:32.477555 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aae65afb-8c95-4ef8-af96-0764a3debb4c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:32.478008 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aae65afb-8c95-4ef8-af96-0764a3debb4c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:32.478462 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aae65afb-8c95-4ef8-af96-0764a3debb4c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:32.609242 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-aae65afb-8c95-4ef8-af96-0764a3debb4c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:32.616879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-aae65afb-8c95-4ef8-af96-0764a3debb4c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1681 microversion: 2.1 time: 0.151844 Sep 23 14:07:32.617436 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 316/624] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:32 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:33.056048 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ffd0ca98-857c-42c5-8030-328a1c1c064e tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083a72310>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:33.086295 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ffd0ca98-857c-42c5-8030-328a1c1c064e tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800" status: 200 len: 286 microversion: 2.1 time: 0.034671 Sep 23 14:07:33.086868 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 309/625] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 23 14:07:33 2022] GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:33.343267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-c7fb152d-7f5f-4168-8023-cec75b7e3300 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:33.343786 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-c7fb152d-7f5f-4168-8023-cec75b7e3300 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:33.349581 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c7fb152d-7f5f-4168-8023-cec75b7e3300 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:33.350072 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c7fb152d-7f5f-4168-8023-cec75b7e3300 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:33.350551 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c7fb152d-7f5f-4168-8023-cec75b7e3300 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:33.351238 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c7fb152d-7f5f-4168-8023-cec75b7e3300 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:33.351694 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c7fb152d-7f5f-4168-8023-cec75b7e3300 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:33.352122 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c7fb152d-7f5f-4168-8023-cec75b7e3300 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:33.480625 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-c7fb152d-7f5f-4168-8023-cec75b7e3300 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:33.488901 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-c7fb152d-7f5f-4168-8023-cec75b7e3300 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:33.490360 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-c7fb152d-7f5f-4168-8023-cec75b7e3300 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:33.491462 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-c7fb152d-7f5f-4168-8023-cec75b7e3300 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1406 microversion: 2.20 time: 0.152762 Sep 23 14:07:33.492025 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 317/626] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:33 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:33.645529 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1912b783-f20d-4396-b10b-fe01278cdaac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:33.645529 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1912b783-f20d-4396-b10b-fe01278cdaac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:33.647680 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1912b783-f20d-4396-b10b-fe01278cdaac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:33.648169 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1912b783-f20d-4396-b10b-fe01278cdaac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:33.648599 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1912b783-f20d-4396-b10b-fe01278cdaac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:33.649287 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1912b783-f20d-4396-b10b-fe01278cdaac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:33.649747 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1912b783-f20d-4396-b10b-fe01278cdaac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:33.650171 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1912b783-f20d-4396-b10b-fe01278cdaac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:33.784673 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1912b783-f20d-4396-b10b-fe01278cdaac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:33.792279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1912b783-f20d-4396-b10b-fe01278cdaac tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1681 microversion: 2.1 time: 0.156640 Sep 23 14:07:33.792836 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 310/627] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:33 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:34.099722 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5bbb1d79-8af8-4118-8411-253267ad0f99 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083f17a60>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:34.129706 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5bbb1d79-8af8-4118-8411-253267ad0f99 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800" status: 200 len: 286 microversion: 2.1 time: 0.034130 Sep 23 14:07:34.130259 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 318/628] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 23 14:07:34 2022] GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:34.516087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-36b9375f-73a6-47e8-a86d-7ed64a7c52e2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:34.516706 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-36b9375f-73a6-47e8-a86d-7ed64a7c52e2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:34.523254 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36b9375f-73a6-47e8-a86d-7ed64a7c52e2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:34.523728 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36b9375f-73a6-47e8-a86d-7ed64a7c52e2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:34.524156 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36b9375f-73a6-47e8-a86d-7ed64a7c52e2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:34.524832 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36b9375f-73a6-47e8-a86d-7ed64a7c52e2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:34.525283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36b9375f-73a6-47e8-a86d-7ed64a7c52e2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:34.525700 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36b9375f-73a6-47e8-a86d-7ed64a7c52e2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:34.656293 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-36b9375f-73a6-47e8-a86d-7ed64a7c52e2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:34.664515 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-36b9375f-73a6-47e8-a86d-7ed64a7c52e2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:34.665954 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-36b9375f-73a6-47e8-a86d-7ed64a7c52e2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:34.670159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-36b9375f-73a6-47e8-a86d-7ed64a7c52e2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1406 microversion: 2.20 time: 0.154874 Sep 23 14:07:34.670159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 311/629] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:34 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:34.815998 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5d4ef9fd-31fb-4835-9882-ce9849c54851 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:34.816535 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-5d4ef9fd-31fb-4835-9882-ce9849c54851 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:34.822447 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d4ef9fd-31fb-4835-9882-ce9849c54851 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:34.822930 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d4ef9fd-31fb-4835-9882-ce9849c54851 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:34.823359 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d4ef9fd-31fb-4835-9882-ce9849c54851 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:34.824042 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d4ef9fd-31fb-4835-9882-ce9849c54851 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:34.824524 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d4ef9fd-31fb-4835-9882-ce9849c54851 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:34.824948 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d4ef9fd-31fb-4835-9882-ce9849c54851 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:34.954935 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5d4ef9fd-31fb-4835-9882-ce9849c54851 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:34.962626 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5d4ef9fd-31fb-4835-9882-ce9849c54851 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1681 microversion: 2.1 time: 0.150445 Sep 23 14:07:34.963190 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 319/630] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:34 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:35.143203 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-44c10d4f-959f-49f7-aef7-6fdb24b1a6c6 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083a555e0>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:35.173380 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-44c10d4f-959f-49f7-aef7-6fdb24b1a6c6 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800" status: 200 len: 286 microversion: 2.1 time: 0.033998 Sep 23 14:07:35.174108 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 312/631] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 23 14:07:35 2022] GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:35.692817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-693b4c0d-40b9-4d21-b3ba-c36f3dd5c1f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:35.693425 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-693b4c0d-40b9-4d21-b3ba-c36f3dd5c1f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:35.699674 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-693b4c0d-40b9-4d21-b3ba-c36f3dd5c1f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:35.700212 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-693b4c0d-40b9-4d21-b3ba-c36f3dd5c1f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:35.700751 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-693b4c0d-40b9-4d21-b3ba-c36f3dd5c1f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:35.701442 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-693b4c0d-40b9-4d21-b3ba-c36f3dd5c1f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:35.701907 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-693b4c0d-40b9-4d21-b3ba-c36f3dd5c1f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:35.702318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-693b4c0d-40b9-4d21-b3ba-c36f3dd5c1f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:35.828274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-693b4c0d-40b9-4d21-b3ba-c36f3dd5c1f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:35.836278 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-693b4c0d-40b9-4d21-b3ba-c36f3dd5c1f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:35.837703 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-693b4c0d-40b9-4d21-b3ba-c36f3dd5c1f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:35.838861 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-693b4c0d-40b9-4d21-b3ba-c36f3dd5c1f9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1406 microversion: 2.20 time: 0.150027 Sep 23 14:07:35.839458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 320/632] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:35 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:35.987174 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b20a7dad-e66d-4063-865c-0ef59370fb6d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:35.987779 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b20a7dad-e66d-4063-865c-0ef59370fb6d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:35.994087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b20a7dad-e66d-4063-865c-0ef59370fb6d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:35.994614 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b20a7dad-e66d-4063-865c-0ef59370fb6d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:35.995052 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b20a7dad-e66d-4063-865c-0ef59370fb6d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:35.995736 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b20a7dad-e66d-4063-865c-0ef59370fb6d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:35.996188 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b20a7dad-e66d-4063-865c-0ef59370fb6d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:35.996610 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b20a7dad-e66d-4063-865c-0ef59370fb6d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:36.042934 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:36.066137 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=10 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:36.128473 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b20a7dad-e66d-4063-865c-0ef59370fb6d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:36.136426 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b20a7dad-e66d-4063-865c-0ef59370fb6d tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1681 microversion: 2.1 time: 0.153862 Sep 23 14:07:36.137028 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 313/633] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:35 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:36.186547 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1ae5aabc-d78e-4b12-ba9d-6cf1566f46fe tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083bd1700>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:36.217747 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1ae5aabc-d78e-4b12-ba9d-6cf1566f46fe tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800" status: 200 len: 287 microversion: 2.1 time: 0.035152 Sep 23 14:07:36.218355 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 321/634] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 23 14:07:36 2022] GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:36.229499 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ad021658-6991-424c-a230-eaeb339b49be tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083aba550>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:36.368695 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ad021658-6991-424c-a230-eaeb339b49be tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800" status: 202 len: 0 microversion: 2.1 time: 0.142988 Sep 23 14:07:36.369265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 314/635] 10.222.0.62 () {58 vars in 1254 bytes} [Fri Sep 23 14:07:36 2022] DELETE /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:07:36.374508 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:36.378468 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e2283944-0ff8-4671-8bd2-76e7f34028b3 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f908895ba60>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:36.409264 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e2283944-0ff8-4671-8bd2-76e7f34028b3 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800" status: 200 len: 286 microversion: 2.1 time: 0.035733 Sep 23 14:07:36.409847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 322/636] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 23 14:07:36 2022] GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:36.864831 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-7ba54b3c-5cd2-4e89-818c-79316d8d0697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:36.865368 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-7ba54b3c-5cd2-4e89-818c-79316d8d0697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:36.871410 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7ba54b3c-5cd2-4e89-818c-79316d8d0697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:36.872864 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7ba54b3c-5cd2-4e89-818c-79316d8d0697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:36.873325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7ba54b3c-5cd2-4e89-818c-79316d8d0697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:36.874027 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7ba54b3c-5cd2-4e89-818c-79316d8d0697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:36.874529 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7ba54b3c-5cd2-4e89-818c-79316d8d0697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:36.874966 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7ba54b3c-5cd2-4e89-818c-79316d8d0697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:36.878910 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:37.006122 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-7ba54b3c-5cd2-4e89-818c-79316d8d0697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:37.014838 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-7ba54b3c-5cd2-4e89-818c-79316d8d0697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:37.016275 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-7ba54b3c-5cd2-4e89-818c-79316d8d0697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:37.017370 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-7ba54b3c-5cd2-4e89-818c-79316d8d0697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1406 microversion: 2.20 time: 0.156548 Sep 23 14:07:37.017933 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 315/637] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:36 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:37.159363 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-974477dd-cda2-4b27-9876-4acb2ffde898 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:37.159899 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-974477dd-cda2-4b27-9876-4acb2ffde898 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:37.167311 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-974477dd-cda2-4b27-9876-4acb2ffde898 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:37.167790 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-974477dd-cda2-4b27-9876-4acb2ffde898 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:37.168224 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-974477dd-cda2-4b27-9876-4acb2ffde898 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:37.169607 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-974477dd-cda2-4b27-9876-4acb2ffde898 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:37.170079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-974477dd-cda2-4b27-9876-4acb2ffde898 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:37.170535 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-974477dd-cda2-4b27-9876-4acb2ffde898 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:37.297126 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-974477dd-cda2-4b27-9876-4acb2ffde898 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:37.304949 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-974477dd-cda2-4b27-9876-4acb2ffde898 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1681 microversion: 2.1 time: 0.149320 Sep 23 14:07:37.305510 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 323/638] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:37 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:37.422950 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6f644d73-e083-4cbe-b536-656287dda509 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083aba790>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:37.449063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-6f644d73-e083-4cbe-b536-656287dda509 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] HTTP exception thrown: Snapshot c99f8141-3048-4111-bff0-8e0b36537800 could not be found. Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6f644d73-e083-4cbe-b536-656287dda509 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Request method failure captured: Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800 HTTP/1.1 Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLb2gk84FmDLxPkeAdHhGWYFjf9_fO8d75FXJlEFsEg_ydZ9J2HkaOa1QzSrdmcEmdAla6D11pegL9otsaF2cPqZXeawc7QAI3tctXRpuYjf-_CNU7rzpS3eCOhXbKMktUXrvrYMToSUT8DVY6AWR750In8Rk-Sh28TP5n_Z2hOHODmo Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 853d8b91b5094dcb9cd8a9c898d4bb94 Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1712404980 Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:07:37.451414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:07:37.455038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/853d8b91b5094dcb9cd8a9c898d4bb94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/853d8b91b5094dcb9cd8a9c898d4bb94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/853d8b91b5094dcb9cd8a9c898d4bb94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_853d8b91b5094dcb9cd8a9c898d4bb94"}]}] Sep 23 14:07:37.455038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1712404980 Sep 23 14:07:37.455038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 853d8b91b5094dcb9cd8a9c898d4bb94 Sep 23 14:07:37.455038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1712404980 Sep 23 14:07:37.455038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-VolumesSnapshotsTestJSON-1712404980-project Sep 23 14:07:37.455038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:07:37.455038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:07:37.455038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 5251c8463b8349008891ae5a9f698821 Sep 23 14:07:37.455038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1712404980-project Sep 23 14:07:37.455038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: Sep 23 14:07:37.455038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Snapshot c99f8141-3048-4111-bff0-8e0b36537800 could not be found. Sep 23 14:07:37.455038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': 'c99f8141-3048-4111-bff0-8e0b36537800'} Sep 23 14:07:37.455038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c99f8141-3048-4111-bff0-8e0b36537800 could not be found. (HTTP 404) (Request-ID: req-b914cef9-6ac5-4eb7-a666-52b28108fac0) Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:37.456063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 14:07:37.457633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c99f8141-3048-4111-bff0-8e0b36537800 could not be found. Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 23 14:07:37.458978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:07:37.460373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c99f8141-3048-4111-bff0-8e0b36537800 could not be found. Sep 23 14:07:37.460373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:37.460373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:37.460373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:37.460373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:37.460373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:37.460373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:37.460373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:07:37.460373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:07:37.460373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c99f8141-3048-4111-bff0-8e0b36537800 could not be found. Sep 23 14:07:37.460373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:37.460373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6f644d73-e083-4cbe-b536-656287dda509 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Returning 404 to user: Snapshot c99f8141-3048-4111-bff0-8e0b36537800 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:07:37.460373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-6f644d73-e083-4cbe-b536-656287dda509 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800" status: 404 len: 111 microversion: 2.1 time: 0.034578 Sep 23 14:07:37.461281 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 316/639] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 23 14:07:37 2022] GET /compute/v2.1/os-snapshots/c99f8141-3048-4111-bff0-8e0b36537800 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:07:37.470949 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-cbfa7e39-d9b3-4aee-a802-13d1d6bd2e5c tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f908895b160>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:37.653972 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-cbfa7e39-d9b3-4aee-a802-13d1d6bd2e5c tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae" status: 202 len: 0 microversion: 2.1 time: 0.186225 Sep 23 14:07:37.654564 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 324/640] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 23 14:07:37 2022] DELETE /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:07:37.662641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ab6b6792-6100-4ef5-99e0-4d125cc77c81 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083a55af0>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:37.709887 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ab6b6792-6100-4ef5-99e0-4d125cc77c81 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae" status: 200 len: 344 microversion: 2.1 time: 0.051078 Sep 23 14:07:37.710501 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 317/641] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 23 14:07:37 2022] GET /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:38.041259 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7a51722a-2354-4986-953b-9765b08acfa3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:38.041866 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7a51722a-2354-4986-953b-9765b08acfa3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:38.048224 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7a51722a-2354-4986-953b-9765b08acfa3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:38.048709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7a51722a-2354-4986-953b-9765b08acfa3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:38.049149 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7a51722a-2354-4986-953b-9765b08acfa3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:38.049867 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7a51722a-2354-4986-953b-9765b08acfa3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:38.050357 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7a51722a-2354-4986-953b-9765b08acfa3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:38.050803 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7a51722a-2354-4986-953b-9765b08acfa3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:38.187719 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7a51722a-2354-4986-953b-9765b08acfa3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:38.195845 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7a51722a-2354-4986-953b-9765b08acfa3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:38.197343 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7a51722a-2354-4986-953b-9765b08acfa3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:38.198470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7a51722a-2354-4986-953b-9765b08acfa3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1406 microversion: 2.20 time: 0.161339 Sep 23 14:07:38.214353 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 325/642] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:38 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:38.330118 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f7ad96e3-a914-437f-bab3-54f6bba7b9a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:38.330808 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f7ad96e3-a914-437f-bab3-54f6bba7b9a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:38.336834 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7ad96e3-a914-437f-bab3-54f6bba7b9a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:38.337353 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7ad96e3-a914-437f-bab3-54f6bba7b9a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:38.337805 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7ad96e3-a914-437f-bab3-54f6bba7b9a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:38.338538 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7ad96e3-a914-437f-bab3-54f6bba7b9a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:38.338997 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7ad96e3-a914-437f-bab3-54f6bba7b9a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:38.339421 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f7ad96e3-a914-437f-bab3-54f6bba7b9a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:38.411058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f7ad96e3-a914-437f-bab3-54f6bba7b9a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:38.420062 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f7ad96e3-a914-437f-bab3-54f6bba7b9a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1614 microversion: 2.1 time: 0.095120 Sep 23 14:07:38.420639 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 318/643] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:38 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:38.725415 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6bb54d76-b4b7-4d3f-ab90-a94bb62aa597 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083a72940>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:38.753368 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-25039795-581b-4b42-a48f-9edbbbc6bb5b req-fa3f7f7a-6387-4399-8978-973aaa769710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eee99559-a86f-4088-9fd1-a6ae97245d92", "name": "network-vif-deleted", "tag": "57f85532-237c-4ac3-8270-603ea7e41e29"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:38.769127 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-25039795-581b-4b42-a48f-9edbbbc6bb5b req-fa3f7f7a-6387-4399-8978-973aaa769710 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:38.771894 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-25039795-581b-4b42-a48f-9edbbbc6bb5b req-fa3f7f7a-6387-4399-8978-973aaa769710 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:38.771894 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-25039795-581b-4b42-a48f-9edbbbc6bb5b req-fa3f7f7a-6387-4399-8978-973aaa769710 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:38.782893 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-25039795-581b-4b42-a48f-9edbbbc6bb5b req-fa3f7f7a-6387-4399-8978-973aaa769710 service nova] Creating event network-vif-deleted:57f85532-237c-4ac3-8270-603ea7e41e29 for instance eee99559-a86f-4088-9fd1-a6ae97245d92 on hv-cinder-85743 Sep 23 14:07:38.786604 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-6bb54d76-b4b7-4d3f-ab90-a94bb62aa597 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] HTTP exception thrown: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.789820 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-25039795-581b-4b42-a48f-9edbbbc6bb5b req-fa3f7f7a-6387-4399-8978-973aaa769710 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120655 Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6bb54d76-b4b7-4d3f-ab90-a94bb62aa597 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Request method failure captured: Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae HTTP/1.1 Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLb2gk84FmDLxPkeAdHhGWYFjf9_fO8d75FXJlEFsEg_ydZ9J2HkaOa1QzSrdmcEmdAla6D11pegL9otsaF2cPqZXeawc7QAI3tctXRpuYjf-_CNU7rzpS3eCOhXbKMktUXrvrYMToSUT8DVY6AWR750In8Rk-Sh28TP5n_Z2hOHODmo Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 853d8b91b5094dcb9cd8a9c898d4bb94 Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1712404980 Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:07:38.789975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:07:38.791552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/853d8b91b5094dcb9cd8a9c898d4bb94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/853d8b91b5094dcb9cd8a9c898d4bb94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/853d8b91b5094dcb9cd8a9c898d4bb94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_853d8b91b5094dcb9cd8a9c898d4bb94"}]}] Sep 23 14:07:38.791552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1712404980 Sep 23 14:07:38.791552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 853d8b91b5094dcb9cd8a9c898d4bb94 Sep 23 14:07:38.791552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1712404980 Sep 23 14:07:38.791552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-VolumesSnapshotsTestJSON-1712404980-project Sep 23 14:07:38.791552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:07:38.791552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:07:38.791552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 5251c8463b8349008891ae5a9f698821 Sep 23 14:07:38.791552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1712404980-project Sep 23 14:07:38.791552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: Sep 23 14:07:38.791552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.791552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae'} Sep 23 14:07:38.791552 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. (HTTP 404) (Request-ID: req-6441011a-0006-454b-86ab-3309db75fbdc) Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:38.792561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 14:07:38.794005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 14:07:38.795822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:07:38.797450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.797450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.797450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:38.797450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.797450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:38.797450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:38.797450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:38.797450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:07:38.797450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:07:38.797450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.797450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.798316 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 326/644] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:38.801585 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6bb54d76-b4b7-4d3f-ab90-a94bb62aa597 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Returning 404 to user: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:07:38.801585 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-6bb54d76-b4b7-4d3f-ab90-a94bb62aa597 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae" status: 404 len: 109 microversion: 2.1 time: 0.071085 Sep 23 14:07:38.801585 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 319/645] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 23 14:07:38 2022] GET /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 14:07:38.804013 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-af358d19-b6ce-4c04-a426-b2b845bcb750 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083d20310>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:38.849302 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-af358d19-b6ce-4c04-a426-b2b845bcb750 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] HTTP exception thrown: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-af358d19-b6ce-4c04-a426-b2b845bcb750 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Request method failure captured: Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: DELETE /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae HTTP/1.1 Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLb2gk84FmDLxPkeAdHhGWYFjf9_fO8d75FXJlEFsEg_ydZ9J2HkaOa1QzSrdmcEmdAla6D11pegL9otsaF2cPqZXeawc7QAI3tctXRpuYjf-_CNU7rzpS3eCOhXbKMktUXrvrYMToSUT8DVY6AWR750In8Rk-Sh28TP5n_Z2hOHODmo Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 853d8b91b5094dcb9cd8a9c898d4bb94 Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1712404980 Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:07:38.851976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:07:38.853398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/853d8b91b5094dcb9cd8a9c898d4bb94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/853d8b91b5094dcb9cd8a9c898d4bb94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/853d8b91b5094dcb9cd8a9c898d4bb94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_853d8b91b5094dcb9cd8a9c898d4bb94"}]}] Sep 23 14:07:38.853398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1712404980 Sep 23 14:07:38.853398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 853d8b91b5094dcb9cd8a9c898d4bb94 Sep 23 14:07:38.853398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1712404980 Sep 23 14:07:38.853398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-VolumesSnapshotsTestJSON-1712404980-project Sep 23 14:07:38.853398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:07:38.853398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:07:38.853398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 5251c8463b8349008891ae5a9f698821 Sep 23 14:07:38.853398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1712404980-project Sep 23 14:07:38.853398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: Sep 23 14:07:38.853398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.853398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': '7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae'} Sep 23 14:07:38.853398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. (HTTP 404) (Request-ID: req-132b1387-628b-47cf-a491-8a24b5f78872) Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:38.854252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 14:07:38.855403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 14:07:38.856559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:07:38.858142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.858142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.858142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:38.858142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.858142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:38.858142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:38.858142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:38.858142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:07:38.858142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:07:38.858142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.858142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.858142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-af358d19-b6ce-4c04-a426-b2b845bcb750 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Returning 404 to user: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:07:38.858142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-af358d19-b6ce-4c04-a426-b2b845bcb750 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae" status: 404 len: 109 microversion: 2.1 time: 0.053685 Sep 23 14:07:38.858142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 327/646] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 23 14:07:38 2022] DELETE /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:07:38.863029 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ff67f554-cd25-45ee-8f23-c9119d77fac8 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Calling method '.version_select at 0x7f9083a555e0>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:38.896151 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-ff67f554-cd25-45ee-8f23-c9119d77fac8 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] HTTP exception thrown: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ff67f554-cd25-45ee-8f23-c9119d77fac8 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Request method failure captured: Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae HTTP/1.1 Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLb2gk84FmDLxPkeAdHhGWYFjf9_fO8d75FXJlEFsEg_ydZ9J2HkaOa1QzSrdmcEmdAla6D11pegL9otsaF2cPqZXeawc7QAI3tctXRpuYjf-_CNU7rzpS3eCOhXbKMktUXrvrYMToSUT8DVY6AWR750In8Rk-Sh28TP5n_Z2hOHODmo Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 853d8b91b5094dcb9cd8a9c898d4bb94 Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1712404980 Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:07:38.898662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:07:38.900230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/853d8b91b5094dcb9cd8a9c898d4bb94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/853d8b91b5094dcb9cd8a9c898d4bb94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/853d8b91b5094dcb9cd8a9c898d4bb94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_853d8b91b5094dcb9cd8a9c898d4bb94"}]}] Sep 23 14:07:38.900230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1712404980 Sep 23 14:07:38.900230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 853d8b91b5094dcb9cd8a9c898d4bb94 Sep 23 14:07:38.900230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1712404980 Sep 23 14:07:38.900230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-VolumesSnapshotsTestJSON-1712404980-project Sep 23 14:07:38.900230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:07:38.900230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:07:38.900230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 5251c8463b8349008891ae5a9f698821 Sep 23 14:07:38.900230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1712404980-project Sep 23 14:07:38.900230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: Sep 23 14:07:38.900230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.900230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae'} Sep 23 14:07:38.900230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. (HTTP 404) (Request-ID: req-8f03050d-34d1-4f5a-b86b-c4f16ca9405d) Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:38.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 14:07:38.903816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 14:07:38.905325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:07:38.906771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.906771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.906771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:38.906771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.906771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:38.906771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:38.906771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:38.906771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:07:38.906771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:07:38.906771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. Sep 23 14:07:38.906771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:38.906771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ff67f554-cd25-45ee-8f23-c9119d77fac8 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] Returning 404 to user: Volume 7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:07:38.906771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ff67f554-cd25-45ee-8f23-c9119d77fac8 tempest-VolumesSnapshotsTestJSON-1712404980 tempest-VolumesSnapshotsTestJSON-1712404980-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae" status: 404 len: 109 microversion: 2.1 time: 0.044105 Sep 23 14:07:38.906771 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 320/647] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 23 14:07:38 2022] GET /compute/v2.1/os-volumes/7d7bcdfb-bd0f-46c5-a3c4-d72cb33551ae => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 14:07:39.224820 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9d6195f8-21fc-4f36-9e72-11c9afa0ebd9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:39.225319 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-9d6195f8-21fc-4f36-9e72-11c9afa0ebd9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:39.232040 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9d6195f8-21fc-4f36-9e72-11c9afa0ebd9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:39.232530 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9d6195f8-21fc-4f36-9e72-11c9afa0ebd9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:39.232993 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9d6195f8-21fc-4f36-9e72-11c9afa0ebd9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:39.233679 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9d6195f8-21fc-4f36-9e72-11c9afa0ebd9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:39.234158 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9d6195f8-21fc-4f36-9e72-11c9afa0ebd9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:39.234804 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9d6195f8-21fc-4f36-9e72-11c9afa0ebd9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:39.392807 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9d6195f8-21fc-4f36-9e72-11c9afa0ebd9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:39.402648 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9d6195f8-21fc-4f36-9e72-11c9afa0ebd9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:39.404392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9d6195f8-21fc-4f36-9e72-11c9afa0ebd9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:39.405755 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-9d6195f8-21fc-4f36-9e72-11c9afa0ebd9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1406 microversion: 2.20 time: 0.185841 Sep 23 14:07:39.406834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 328/648] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:39 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:39.445411 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1a8da9fb-b099-4696-b8d2-443da787b789 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:39.446751 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1a8da9fb-b099-4696-b8d2-443da787b789 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:39.453871 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a8da9fb-b099-4696-b8d2-443da787b789 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:39.454396 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a8da9fb-b099-4696-b8d2-443da787b789 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:39.455007 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a8da9fb-b099-4696-b8d2-443da787b789 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:39.455720 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a8da9fb-b099-4696-b8d2-443da787b789 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:39.456181 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a8da9fb-b099-4696-b8d2-443da787b789 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:39.456660 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a8da9fb-b099-4696-b8d2-443da787b789 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:39.489682 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a8da9fb-b099-4696-b8d2-443da787b789 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:39.490172 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a8da9fb-b099-4696-b8d2-443da787b789 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:39.490754 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a8da9fb-b099-4696-b8d2-443da787b789 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:39.491210 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-1a8da9fb-b099-4696-b8d2-443da787b789 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lazy-loading 'fault' on Instance uuid eee99559-a86f-4088-9fd1-a6ae97245d92 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:07:39.541619 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1a8da9fb-b099-4696-b8d2-443da787b789 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:39.550131 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1a8da9fb-b099-4696-b8d2-443da787b789 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 200 len: 1331 microversion: 2.1 time: 0.109220 Sep 23 14:07:39.550747 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 321/649] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:39 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:40.433319 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-72c33af9-8cec-4549-a607-6f9b9e441c29 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:40.433950 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-72c33af9-8cec-4549-a607-6f9b9e441c29 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:40.440123 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-72c33af9-8cec-4549-a607-6f9b9e441c29 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:40.440601 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-72c33af9-8cec-4549-a607-6f9b9e441c29 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:40.441037 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-72c33af9-8cec-4549-a607-6f9b9e441c29 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:40.441720 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-72c33af9-8cec-4549-a607-6f9b9e441c29 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:40.442172 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-72c33af9-8cec-4549-a607-6f9b9e441c29 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:40.442624 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-72c33af9-8cec-4549-a607-6f9b9e441c29 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:40.572443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-72c33af9-8cec-4549-a607-6f9b9e441c29 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:40.574635 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e2497d0e-20f9-4ca2-af48-d3da461542ef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:40.575287 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e2497d0e-20f9-4ca2-af48-d3da461542ef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:40.583153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e2497d0e-20f9-4ca2-af48-d3da461542ef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:40.583643 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e2497d0e-20f9-4ca2-af48-d3da461542ef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:40.584021 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-72c33af9-8cec-4549-a607-6f9b9e441c29 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:40.590285 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e2497d0e-20f9-4ca2-af48-d3da461542ef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:40.590285 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e2497d0e-20f9-4ca2-af48-d3da461542ef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:40.590285 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e2497d0e-20f9-4ca2-af48-d3da461542ef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:40.590684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-72c33af9-8cec-4549-a607-6f9b9e441c29 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:40.590788 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e2497d0e-20f9-4ca2-af48-d3da461542ef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:40.590906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-72c33af9-8cec-4549-a607-6f9b9e441c29 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1406 microversion: 2.20 time: 0.159156 Sep 23 14:07:40.590906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 329/650] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:40 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:40.599524 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-e2497d0e-20f9-4ca2-af48-d3da461542ef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] HTTP exception thrown: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e2497d0e-20f9-4ca2-af48-d3da461542ef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Request method failure captured: Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 HTTP/1.1 Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbxrzANyu0HiE-RI6YrwV4d8fV10ylWEIATegCXV8WUB95m5oAKUEypeFaRSmFIPzbJ8OQMl6Aud1_-7wjU4ZO6GDRxJPylRi9sW9fsJGE2eeMrNRP5hVeqDi3IdZCENn82q0KEmt_9wVferpVh22qvGQNXZFPNp1vMViuNoGirJUN4 Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:07:40.601037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:07:40.602511 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_482490c45ac64607bba9ad021f2effbf"}]}] Sep 23 14:07:40.602511 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:07:40.602511 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:07:40.602511 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:07:40.602511 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:07:40.602511 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:07:40.602511 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:07:40.602511 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 0db30f990aae49fabf9b8b19cd019de9 Sep 23 14:07:40.602511 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:07:40.602511 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:07:40.602511 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:07:40.602511 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': 'eee99559-a86f-4088-9fd1-a6ae97245d92'} Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:07:40.603344 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:07:40.604731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:40.605981 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e2497d0e-20f9-4ca2-af48-d3da461542ef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Returning 404 to user: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:07:40.605981 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e2497d0e-20f9-4ca2-af48-d3da461542ef tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 404 len: 111 microversion: 2.1 time: 0.031713 Sep 23 14:07:40.605981 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 322/651] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:40 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 14:07:40.611306 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-52f7dff1-236c-48e7-a355-2e11825747c4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '.version_select at 0x7f9083bd1310>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:40.695719 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-52f7dff1-236c-48e7-a355-2e11825747c4 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2004025262" status: 202 len: 0 microversion: 2.1 time: 0.088305 Sep 23 14:07:40.696561 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 330/652] 10.222.0.62 () {58 vars in 1221 bytes} [Fri Sep 23 14:07:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2004025262 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:07:40.965207 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-b06543c0-47d5-4dce-952e-2d183ec2db2a req-69cc3e31-f57a-4c8e-b00e-d1eb41e32e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49eff20-f8a6-404b-b09c-def6e4c167ca", "name": "network-vif-plugged", "status": "completed", "tag": "20043706-94ae-416a-96d1-e1f2fc14183b"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:40.979057 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-b06543c0-47d5-4dce-952e-2d183ec2db2a req-69cc3e31-f57a-4c8e-b00e-d1eb41e32e7c service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:40.979616 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-b06543c0-47d5-4dce-952e-2d183ec2db2a req-69cc3e31-f57a-4c8e-b00e-d1eb41e32e7c service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:40.980269 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-b06543c0-47d5-4dce-952e-2d183ec2db2a req-69cc3e31-f57a-4c8e-b00e-d1eb41e32e7c service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:40.994730 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-b06543c0-47d5-4dce-952e-2d183ec2db2a req-69cc3e31-f57a-4c8e-b00e-d1eb41e32e7c service nova] Creating event network-vif-plugged:20043706-94ae-416a-96d1-e1f2fc14183b for instance c49eff20-f8a6-404b-b09c-def6e4c167ca on hv-cinder-85743 Sep 23 14:07:41.000635 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-b06543c0-47d5-4dce-952e-2d183ec2db2a req-69cc3e31-f57a-4c8e-b00e-d1eb41e32e7c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039181 Sep 23 14:07:41.001238 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 323/653] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:41.291168 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-dbca423b-7abc-4863-8158-7b06f7efbe2a tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] Action: 'create', calling method: .version_select at 0x7f9083becd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-631481078", "metadata": {"Type": "work"}}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:41.487444 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-21057f63-8e2d-4654-b4e9-c40f13f3e63c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Action: 'create', calling method: .version_select at 0x7f9083a16d30>, body: {"keypair": {"name": "tempest-keypair-1343929215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgo2JZWH4c0WLM+iKXTMxUXEhOseBTx0H8G6LCFZ7t6/KXz43PwuW+sFZeGPFlySeLam2YA66HiQ1IVOB+WrxbHDxbELegM/uk9gfLTo1GPJTXz0qN1nWmxR98OvNA0uw=="}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:41.503065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-21057f63-8e2d-4654-b4e9-c40f13f3e63c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for project 482490c45ac64607bba9ad021f2effbf. Resources: {'key_pairs'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:07:41.506840 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-21057f63-8e2d-4654-b4e9-c40f13f3e63c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for user 0db30f990aae49fabf9b8b19cd019de9 and project 482490c45ac64607bba9ad021f2effbf. Resources: {'key_pairs'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:07:41.586363 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-21057f63-8e2d-4654-b4e9-c40f13f3e63c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103148 Sep 23 14:07:41.587027 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 324/654] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 23 14:07:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:07:41.612563 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d3b38fe3-f91a-4554-909c-d366d51cc87d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:41.613280 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d3b38fe3-f91a-4554-909c-d366d51cc87d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:41.616255 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:41.620400 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d3b38fe3-f91a-4554-909c-d366d51cc87d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:41.620882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d3b38fe3-f91a-4554-909c-d366d51cc87d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:41.621319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d3b38fe3-f91a-4554-909c-d366d51cc87d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:41.622020 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d3b38fe3-f91a-4554-909c-d366d51cc87d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:41.622480 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d3b38fe3-f91a-4554-909c-d366d51cc87d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:41.622972 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d3b38fe3-f91a-4554-909c-d366d51cc87d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:41.784940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d3b38fe3-f91a-4554-909c-d366d51cc87d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:41.793038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d3b38fe3-f91a-4554-909c-d366d51cc87d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:41.794514 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d3b38fe3-f91a-4554-909c-d366d51cc87d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:41.796042 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d3b38fe3-f91a-4554-909c-d366d51cc87d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1406 microversion: 2.20 time: 0.187262 Sep 23 14:07:41.796515 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 325/655] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:41 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:07:41.968306 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-dbca423b-7abc-4863-8158-7b06f7efbe2a tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.813239 Sep 23 14:07:41.968923 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 331/656] 10.222.0.62 () {60 vars in 1156 bytes} [Fri Sep 23 14:07:41 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 815 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 23 14:07:41.981515 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-262fe664-ecdb-4244-8e50-66d8195cdfa6 tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] Calling method '.version_select at 0x7f9083a16f70>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:42.036078 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-262fe664-ecdb-4244-8e50-66d8195cdfa6 tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/a115dcb4-3724-4c15-b40e-289e1df1c35a" status: 200 len: 352 microversion: 2.1 time: 0.058232 Sep 23 14:07:42.036924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 326/657] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 23 14:07:41 2022] GET /compute/v2.1/os-volumes/a115dcb4-3724-4c15-b40e-289e1df1c35a => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:42.821030 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fde28c39-1b36-4d73-92a0-dc1e4428e98d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:42.821561 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-fde28c39-1b36-4d73-92a0-dc1e4428e98d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:42.828895 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fde28c39-1b36-4d73-92a0-dc1e4428e98d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:42.835280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fde28c39-1b36-4d73-92a0-dc1e4428e98d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:42.835280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fde28c39-1b36-4d73-92a0-dc1e4428e98d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:42.835280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fde28c39-1b36-4d73-92a0-dc1e4428e98d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:42.835280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fde28c39-1b36-4d73-92a0-dc1e4428e98d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:42.835663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fde28c39-1b36-4d73-92a0-dc1e4428e98d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:42.971583 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fde28c39-1b36-4d73-92a0-dc1e4428e98d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:42.979724 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fde28c39-1b36-4d73-92a0-dc1e4428e98d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:42.981206 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fde28c39-1b36-4d73-92a0-dc1e4428e98d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:42.982311 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fde28c39-1b36-4d73-92a0-dc1e4428e98d tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1406 microversion: 2.20 time: 0.165354 Sep 23 14:07:42.982886 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 332/658] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:42 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:43.052442 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a210b3b4-625d-4601-92b2-638658bc1155 tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] Calling method '.version_select at 0x7f9083a16b80>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:43.101020 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a210b3b4-625d-4601-92b2-638658bc1155 tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/a115dcb4-3724-4c15-b40e-289e1df1c35a" status: 200 len: 353 microversion: 2.1 time: 0.053178 Sep 23 14:07:43.101672 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 327/659] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 23 14:07:43 2022] GET /compute/v2.1/os-volumes/a115dcb4-3724-4c15-b40e-289e1df1c35a => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:43.115093 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-def013d6-fa04-4f1d-9d54-8e2fb8f39647 tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] Calling method '.version_select at 0x7f9083b91c10>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:43.170639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-def013d6-fa04-4f1d-9d54-8e2fb8f39647 tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/a115dcb4-3724-4c15-b40e-289e1df1c35a" status: 200 len: 353 microversion: 2.1 time: 0.059311 Sep 23 14:07:43.171327 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 333/660] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 23 14:07:43 2022] GET /compute/v2.1/os-volumes/a115dcb4-3724-4c15-b40e-289e1df1c35a => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:43.189523 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5e7e90ae-70d6-4ea0-8e55-67dfa24bc016 tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] Calling method '.version_select at 0x7f9083aba3a0>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:43.420201 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5e7e90ae-70d6-4ea0-8e55-67dfa24bc016 tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/a115dcb4-3724-4c15-b40e-289e1df1c35a" status: 202 len: 0 microversion: 2.1 time: 0.234530 Sep 23 14:07:43.424733 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 328/661] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 23 14:07:43 2022] DELETE /compute/v2.1/os-volumes/a115dcb4-3724-4c15-b40e-289e1df1c35a => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:07:43.430130 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fa8b806c-27b2-4c13-8db8-56f793625b94 tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] Calling method '.version_select at 0x7f9083b91430>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:43.481704 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fa8b806c-27b2-4c13-8db8-56f793625b94 tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/a115dcb4-3724-4c15-b40e-289e1df1c35a" status: 200 len: 352 microversion: 2.1 time: 0.053432 Sep 23 14:07:43.481704 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 334/662] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 23 14:07:43 2022] GET /compute/v2.1/os-volumes/a115dcb4-3724-4c15-b40e-289e1df1c35a => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:44.010227 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d54e12e0-2b55-4bfe-a848-3a375f9b6369 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:44.010227 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d54e12e0-2b55-4bfe-a848-3a375f9b6369 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:44.015961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d54e12e0-2b55-4bfe-a848-3a375f9b6369 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:44.016453 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d54e12e0-2b55-4bfe-a848-3a375f9b6369 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:44.016895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d54e12e0-2b55-4bfe-a848-3a375f9b6369 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:44.017679 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d54e12e0-2b55-4bfe-a848-3a375f9b6369 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:44.018136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d54e12e0-2b55-4bfe-a848-3a375f9b6369 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:44.018595 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d54e12e0-2b55-4bfe-a848-3a375f9b6369 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:44.033029 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-120250763", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34e7a0c6-e35b-482b-a11c-b3c893e03a50"}], "security_groups": [{"name": "tempest-securitygroup--816297846"}], "key_name": "tempest-keypair-1343929215", "user_data": "}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:44.175501 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.network.neutron [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] validate_networks() for [('34e7a0c6-e35b-482b-a11c-b3c893e03a50', None, None, None, None, None)] {{(pid=121074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:07:44.180098 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d54e12e0-2b55-4bfe-a848-3a375f9b6369 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:44.188357 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d54e12e0-2b55-4bfe-a848-3a375f9b6369 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:44.189829 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d54e12e0-2b55-4bfe-a848-3a375f9b6369 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:44.190996 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d54e12e0-2b55-4bfe-a848-3a375f9b6369 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1598 microversion: 2.20 time: 0.187348 Sep 23 14:07:44.191558 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 329/663] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:07:44 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1598 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:07:44.216095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-dd7c30c7-edf5-4d2e-8777-d5aa2431e7d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:44.216581 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-dd7c30c7-edf5-4d2e-8777-d5aa2431e7d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:44.223143 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dd7c30c7-edf5-4d2e-8777-d5aa2431e7d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:44.223655 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dd7c30c7-edf5-4d2e-8777-d5aa2431e7d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:44.224084 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dd7c30c7-edf5-4d2e-8777-d5aa2431e7d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:44.224769 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dd7c30c7-edf5-4d2e-8777-d5aa2431e7d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:44.225216 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dd7c30c7-edf5-4d2e-8777-d5aa2431e7d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:44.225632 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dd7c30c7-edf5-4d2e-8777-d5aa2431e7d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:44.319706 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-dd7c30c7-edf5-4d2e-8777-d5aa2431e7d9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107878 Sep 23 14:07:44.320387 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 330/664] 10.222.0.62 () {60 vars in 1316 bytes} [Fri Sep 23 14:07:44 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 14:07:44.494091 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-29376261-d2a1-4f44-80ab-ff23906a3fbc tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] Calling method '.version_select at 0x7f9083aa0790>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-29376261-d2a1-4f44-80ab-ff23906a3fbc tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] HTTP exception thrown: Volume a115dcb4-3724-4c15-b40e-289e1df1c35a could not be found. Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-29376261-d2a1-4f44-80ab-ff23906a3fbc tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] Request method failure captured: Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/os-volumes/a115dcb4-3724-4c15-b40e-289e1df1c35a HTTP/1.1 Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLb2tDFdhO-Dng1kcambL4UfcK2ECFyeWxJmhhjKw9iXqsPvVjam-ScwrcDYHkEM_00xdnq0THyCRh5fAoWugLDE513umZ94pVoE2mnum74c76qRV9fgM75IO4leDPo_zQXqkqUrzHnfm5TZpuQ64X1MRPjiUFrbdOtrW6cfg0iXxq1Q Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: cde9af51563941bfb0e4e77f411c833d Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-VolumesGetTestJSON-1743825258 Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:07:44.528482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:07:44.530315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cde9af51563941bfb0e4e77f411c833d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cde9af51563941bfb0e4e77f411c833d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cde9af51563941bfb0e4e77f411c833d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cde9af51563941bfb0e4e77f411c833d"}]}] Sep 23 14:07:44.530315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-VolumesGetTestJSON-1743825258 Sep 23 14:07:44.530315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: cde9af51563941bfb0e4e77f411c833d Sep 23 14:07:44.530315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-VolumesGetTestJSON-1743825258 Sep 23 14:07:44.530315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-VolumesGetTestJSON-1743825258-project Sep 23 14:07:44.530315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:07:44.530315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:07:44.530315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 39abe550c3924d76bfa61305e6a61de0 Sep 23 14:07:44.530315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-VolumesGetTestJSON-1743825258-project Sep 23 14:07:44.530315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: Sep 23 14:07:44.530315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Volume a115dcb4-3724-4c15-b40e-289e1df1c35a could not be found. Sep 23 14:07:44.530315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': 'a115dcb4-3724-4c15-b40e-289e1df1c35a'} Sep 23 14:07:44.530315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a115dcb4-3724-4c15-b40e-289e1df1c35a could not be found. (HTTP 404) (Request-ID: req-6660924a-55ca-4221-a5f1-a38dff299def) Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:44.531300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 14:07:44.533058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a115dcb4-3724-4c15-b40e-289e1df1c35a could not be found. Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 14:07:44.534136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:07:44.535305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a115dcb4-3724-4c15-b40e-289e1df1c35a could not be found. Sep 23 14:07:44.535305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:44.535305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:07:44.535305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:44.535305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:07:44.535305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:07:44.535305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:07:44.535305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:07:44.535305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:07:44.535305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a115dcb4-3724-4c15-b40e-289e1df1c35a could not be found. Sep 23 14:07:44.535305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:07:44.535305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-29376261-d2a1-4f44-80ab-ff23906a3fbc tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] Returning 404 to user: Volume a115dcb4-3724-4c15-b40e-289e1df1c35a could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:07:44.535305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-29376261-d2a1-4f44-80ab-ff23906a3fbc tempest-VolumesGetTestJSON-1743825258 tempest-VolumesGetTestJSON-1743825258-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/a115dcb4-3724-4c15-b40e-289e1df1c35a" status: 404 len: 109 microversion: 2.1 time: 0.039629 Sep 23 14:07:44.535305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 331/665] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 23 14:07:44 2022] GET /compute/v2.1/os-volumes/a115dcb4-3724-4c15-b40e-289e1df1c35a => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:07:44.992359 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Flavor limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:07:44.992774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Image limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:07:44.993853 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Flavor pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:07:44.994306 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Image pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:07:45.001063 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:07:45.007217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:45.007715 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:45.008155 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:45.008886 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:45.009346 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:45.009779 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:45.033032 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for project 482490c45ac64607bba9ad021f2effbf. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:07:45.037427 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Getting quotas for user 0db30f990aae49fabf9b8b19cd019de9 and project 482490c45ac64607bba9ad021f2effbf. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:07:45.049632 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Going to run 1 instances... {{(pid=121074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:07:45.052464 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:07:45.196913 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b03835a7-a288-4ed3-ab8a-076175dfb15a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.168760 Sep 23 14:07:45.204370 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 335/666] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:07:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 14:07:45.210220 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ad1ce511-9faa-4a89-a6d6-bf61232e2fdc tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:45.212071 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ad1ce511-9faa-4a89-a6d6-bf61232e2fdc tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:45.461207 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ad1ce511-9faa-4a89-a6d6-bf61232e2fdc tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:45.468943 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ad1ce511-9faa-4a89-a6d6-bf61232e2fdc tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1241 microversion: 2.1 time: 0.262890 Sep 23 14:07:45.469674 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 332/667] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:45 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1241 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:46.057362 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-06b829c4-1daf-4986-ae61-7f0396514d0c req-f644a416-4d1f-4136-8796-b79ff182bd64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c49eff20-f8a6-404b-b09c-def6e4c167ca", "tag": "20043706-94ae-416a-96d1-e1f2fc14183b"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:46.068341 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-06b829c4-1daf-4986-ae61-7f0396514d0c req-f644a416-4d1f-4136-8796-b79ff182bd64 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:46.069076 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-06b829c4-1daf-4986-ae61-7f0396514d0c req-f644a416-4d1f-4136-8796-b79ff182bd64 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:46.069599 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-06b829c4-1daf-4986-ae61-7f0396514d0c req-f644a416-4d1f-4136-8796-b79ff182bd64 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:46.080994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-06b829c4-1daf-4986-ae61-7f0396514d0c req-f644a416-4d1f-4136-8796-b79ff182bd64 service nova] Creating event network-changed:20043706-94ae-416a-96d1-e1f2fc14183b for instance c49eff20-f8a6-404b-b09c-def6e4c167ca on hv-cinder-85743 Sep 23 14:07:46.086469 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-06b829c4-1daf-4986-ae61-7f0396514d0c req-f644a416-4d1f-4136-8796-b79ff182bd64 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243411 Sep 23 14:07:46.087467 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 336/668] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:46.491784 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c5f7be64-46d1-4309-85e4-c771d476c3d0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:46.493168 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c5f7be64-46d1-4309-85e4-c771d476c3d0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:46.504721 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c5f7be64-46d1-4309-85e4-c771d476c3d0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:46.504721 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c5f7be64-46d1-4309-85e4-c771d476c3d0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:46.504721 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c5f7be64-46d1-4309-85e4-c771d476c3d0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:46.505765 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c5f7be64-46d1-4309-85e4-c771d476c3d0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:46.506465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c5f7be64-46d1-4309-85e4-c771d476c3d0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:46.507113 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c5f7be64-46d1-4309-85e4-c771d476c3d0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:46.582909 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c5f7be64-46d1-4309-85e4-c771d476c3d0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:46.591913 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c5f7be64-46d1-4309-85e4-c771d476c3d0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1237 microversion: 2.1 time: 0.104400 Sep 23 14:07:46.592911 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 333/669] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:46 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1237 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:47.615980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-769fcceb-a94c-4320-88d1-19662e5a8fc5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:47.616711 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-769fcceb-a94c-4320-88d1-19662e5a8fc5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:47.623329 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-769fcceb-a94c-4320-88d1-19662e5a8fc5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:47.623953 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-769fcceb-a94c-4320-88d1-19662e5a8fc5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:47.624264 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-769fcceb-a94c-4320-88d1-19662e5a8fc5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:47.625022 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-769fcceb-a94c-4320-88d1-19662e5a8fc5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:47.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-769fcceb-a94c-4320-88d1-19662e5a8fc5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:47.626071 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-769fcceb-a94c-4320-88d1-19662e5a8fc5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:47.696537 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-769fcceb-a94c-4320-88d1-19662e5a8fc5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:47.707643 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-769fcceb-a94c-4320-88d1-19662e5a8fc5 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1311 microversion: 2.1 time: 0.095797 Sep 23 14:07:47.708216 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 337/670] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:47 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:48.731795 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-cb70484a-12f5-4ce6-9d5d-00facb5bf6b0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:48.732407 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-cb70484a-12f5-4ce6-9d5d-00facb5bf6b0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:48.739683 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cb70484a-12f5-4ce6-9d5d-00facb5bf6b0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:48.740382 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cb70484a-12f5-4ce6-9d5d-00facb5bf6b0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:48.740819 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cb70484a-12f5-4ce6-9d5d-00facb5bf6b0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:48.741508 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cb70484a-12f5-4ce6-9d5d-00facb5bf6b0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:48.741959 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cb70484a-12f5-4ce6-9d5d-00facb5bf6b0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:48.742403 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cb70484a-12f5-4ce6-9d5d-00facb5bf6b0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:48.877456 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-cb70484a-12f5-4ce6-9d5d-00facb5bf6b0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:48.886250 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-cb70484a-12f5-4ce6-9d5d-00facb5bf6b0 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1366 microversion: 2.1 time: 0.158248 Sep 23 14:07:48.887085 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 334/671] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:48 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:49.276648 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-83001b7d-3258-4a55-a7ad-de51c377c9e4 req-9ec35583-9143-46de-aebe-7ebee70f0c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eabc1ecf-db30-497e-ab52-807dbb0f9a09", "tag": "9f434098-b75f-420c-929f-b2ab8d58d384"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:49.287927 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-83001b7d-3258-4a55-a7ad-de51c377c9e4 req-9ec35583-9143-46de-aebe-7ebee70f0c1f service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:49.288783 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-83001b7d-3258-4a55-a7ad-de51c377c9e4 req-9ec35583-9143-46de-aebe-7ebee70f0c1f service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:49.289214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-83001b7d-3258-4a55-a7ad-de51c377c9e4 req-9ec35583-9143-46de-aebe-7ebee70f0c1f service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:49.301700 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-83001b7d-3258-4a55-a7ad-de51c377c9e4 req-9ec35583-9143-46de-aebe-7ebee70f0c1f service nova] Creating event network-changed:9f434098-b75f-420c-929f-b2ab8d58d384 for instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 on hv-cinder-85743 Sep 23 14:07:49.307008 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-83001b7d-3258-4a55-a7ad-de51c377c9e4 req-9ec35583-9143-46de-aebe-7ebee70f0c1f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034213 Sep 23 14:07:49.307617 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 338/672] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:07:49.914131 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6420890f-07a7-481a-af8f-2034d9cae80b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:49.914816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-6420890f-07a7-481a-af8f-2034d9cae80b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:49.921842 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6420890f-07a7-481a-af8f-2034d9cae80b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:49.922952 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6420890f-07a7-481a-af8f-2034d9cae80b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:49.923400 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6420890f-07a7-481a-af8f-2034d9cae80b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:49.924132 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6420890f-07a7-481a-af8f-2034d9cae80b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:49.924596 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6420890f-07a7-481a-af8f-2034d9cae80b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:49.925017 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6420890f-07a7-481a-af8f-2034d9cae80b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:50.084155 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-6420890f-07a7-481a-af8f-2034d9cae80b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:50.092689 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-6420890f-07a7-481a-af8f-2034d9cae80b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1366 microversion: 2.1 time: 0.182441 Sep 23 14:07:50.119617 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 335/673] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:49 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:51.117290 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1b323a52-25f1-4053-9f6d-22a3073b1d05 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:51.117982 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1b323a52-25f1-4053-9f6d-22a3073b1d05 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:51.124012 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b323a52-25f1-4053-9f6d-22a3073b1d05 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:51.124490 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b323a52-25f1-4053-9f6d-22a3073b1d05 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:51.124947 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b323a52-25f1-4053-9f6d-22a3073b1d05 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:51.125593 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b323a52-25f1-4053-9f6d-22a3073b1d05 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:51.126043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b323a52-25f1-4053-9f6d-22a3073b1d05 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:51.126492 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b323a52-25f1-4053-9f6d-22a3073b1d05 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:51.145393 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:51.263568 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-1b323a52-25f1-4053-9f6d-22a3073b1d05 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:51.271655 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1b323a52-25f1-4053-9f6d-22a3073b1d05 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1366 microversion: 2.1 time: 0.158587 Sep 23 14:07:51.272212 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 339/674] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:51 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:52.294943 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e9e4637b-54a1-4ec5-815d-4b07c87ad9d1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:52.295493 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e9e4637b-54a1-4ec5-815d-4b07c87ad9d1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:52.302513 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9e4637b-54a1-4ec5-815d-4b07c87ad9d1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:52.302996 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9e4637b-54a1-4ec5-815d-4b07c87ad9d1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:52.303430 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9e4637b-54a1-4ec5-815d-4b07c87ad9d1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:52.304109 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9e4637b-54a1-4ec5-815d-4b07c87ad9d1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:52.304562 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9e4637b-54a1-4ec5-815d-4b07c87ad9d1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:52.304986 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9e4637b-54a1-4ec5-815d-4b07c87ad9d1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:52.431493 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e9e4637b-54a1-4ec5-815d-4b07c87ad9d1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:52.439814 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e9e4637b-54a1-4ec5-815d-4b07c87ad9d1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1366 microversion: 2.1 time: 0.148794 Sep 23 14:07:52.440364 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 336/675] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:52 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:53.462453 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-690a47b9-7a0c-429f-a0ba-4d4de50b5c12 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:53.463065 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-690a47b9-7a0c-429f-a0ba-4d4de50b5c12 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:53.464916 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:53.470090 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-690a47b9-7a0c-429f-a0ba-4d4de50b5c12 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:53.470610 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-690a47b9-7a0c-429f-a0ba-4d4de50b5c12 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:53.471053 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-690a47b9-7a0c-429f-a0ba-4d4de50b5c12 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:53.471746 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-690a47b9-7a0c-429f-a0ba-4d4de50b5c12 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:53.472241 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-690a47b9-7a0c-429f-a0ba-4d4de50b5c12 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:53.472670 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-690a47b9-7a0c-429f-a0ba-4d4de50b5c12 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:53.601598 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-690a47b9-7a0c-429f-a0ba-4d4de50b5c12 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:53.610184 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-690a47b9-7a0c-429f-a0ba-4d4de50b5c12 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1366 microversion: 2.1 time: 0.151591 Sep 23 14:07:53.610775 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 340/676] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:53 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:54.633109 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8b707b23-bd57-4ae4-8de3-c1fe5ca8eb26 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:54.633695 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-8b707b23-bd57-4ae4-8de3-c1fe5ca8eb26 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:54.640846 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8b707b23-bd57-4ae4-8de3-c1fe5ca8eb26 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:54.641352 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8b707b23-bd57-4ae4-8de3-c1fe5ca8eb26 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:54.641786 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8b707b23-bd57-4ae4-8de3-c1fe5ca8eb26 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:54.642498 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8b707b23-bd57-4ae4-8de3-c1fe5ca8eb26 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:54.642956 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8b707b23-bd57-4ae4-8de3-c1fe5ca8eb26 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:54.643381 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8b707b23-bd57-4ae4-8de3-c1fe5ca8eb26 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:54.786984 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-8b707b23-bd57-4ae4-8de3-c1fe5ca8eb26 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:54.794544 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8b707b23-bd57-4ae4-8de3-c1fe5ca8eb26 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1366 microversion: 2.1 time: 0.165325 Sep 23 14:07:54.795108 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 337/677] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:54 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:07:55.817621 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-75a9bcb6-3b8d-4d38-b6ea-935da257058b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:55.818317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-75a9bcb6-3b8d-4d38-b6ea-935da257058b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:55.820180 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:55.820880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=6 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:55.825510 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-75a9bcb6-3b8d-4d38-b6ea-935da257058b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:55.825998 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-75a9bcb6-3b8d-4d38-b6ea-935da257058b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:55.826471 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-75a9bcb6-3b8d-4d38-b6ea-935da257058b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:55.827213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-75a9bcb6-3b8d-4d38-b6ea-935da257058b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:55.827690 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-75a9bcb6-3b8d-4d38-b6ea-935da257058b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:55.828156 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-75a9bcb6-3b8d-4d38-b6ea-935da257058b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:55.960887 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-75a9bcb6-3b8d-4d38-b6ea-935da257058b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:55.969040 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-75a9bcb6-3b8d-4d38-b6ea-935da257058b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1366 microversion: 2.1 time: 0.154864 Sep 23 14:07:55.969669 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 341/678] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:55 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:56.991954 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a85649e2-d165-4218-9dca-185f3436ac40 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:56.992558 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a85649e2-d165-4218-9dca-185f3436ac40 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:56.994721 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=6 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:57.000244 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a85649e2-d165-4218-9dca-185f3436ac40 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:57.001413 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a85649e2-d165-4218-9dca-185f3436ac40 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:57.001832 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a85649e2-d165-4218-9dca-185f3436ac40 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:57.002557 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a85649e2-d165-4218-9dca-185f3436ac40 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:57.003012 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a85649e2-d165-4218-9dca-185f3436ac40 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:57.003430 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a85649e2-d165-4218-9dca-185f3436ac40 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:57.144842 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a85649e2-d165-4218-9dca-185f3436ac40 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:57.152783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a85649e2-d165-4218-9dca-185f3436ac40 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1366 microversion: 2.1 time: 0.164726 Sep 23 14:07:57.153362 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 338/679] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:56 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:57.331436 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-0bf2b028-f37e-4664-85fc-78fc6360bf70 req-7ec47b63-bbe4-479e-a49e-2019cc0bb6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eabc1ecf-db30-497e-ab52-807dbb0f9a09", "name": "network-vif-plugged", "status": "completed", "tag": "9f434098-b75f-420c-929f-b2ab8d58d384"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:07:57.340853 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-0bf2b028-f37e-4664-85fc-78fc6360bf70 req-7ec47b63-bbe4-479e-a49e-2019cc0bb6e6 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:57.344872 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-0bf2b028-f37e-4664-85fc-78fc6360bf70 req-7ec47b63-bbe4-479e-a49e-2019cc0bb6e6 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:57.344872 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-0bf2b028-f37e-4664-85fc-78fc6360bf70 req-7ec47b63-bbe4-479e-a49e-2019cc0bb6e6 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:57.352603 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-0bf2b028-f37e-4664-85fc-78fc6360bf70 req-7ec47b63-bbe4-479e-a49e-2019cc0bb6e6 service nova] Creating event network-vif-plugged:9f434098-b75f-420c-929f-b2ab8d58d384 for instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 on hv-cinder-85743 Sep 23 14:07:57.357650 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-0bf2b028-f37e-4664-85fc-78fc6360bf70 req-7ec47b63-bbe4-479e-a49e-2019cc0bb6e6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144738 Sep 23 14:07:57.358627 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 342/680] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:07:58.177641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-634d660a-db6a-44cc-852e-b6e5353f086c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:58.180673 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-634d660a-db6a-44cc-852e-b6e5353f086c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:58.184875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-634d660a-db6a-44cc-852e-b6e5353f086c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:58.185412 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-634d660a-db6a-44cc-852e-b6e5353f086c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:58.185843 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-634d660a-db6a-44cc-852e-b6e5353f086c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:58.186555 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-634d660a-db6a-44cc-852e-b6e5353f086c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:58.187008 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-634d660a-db6a-44cc-852e-b6e5353f086c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:58.187431 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-634d660a-db6a-44cc-852e-b6e5353f086c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:58.332580 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-634d660a-db6a-44cc-852e-b6e5353f086c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:58.335012 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-634d660a-db6a-44cc-852e-b6e5353f086c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1366 microversion: 2.1 time: 0.159620 Sep 23 14:07:58.335012 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 339/681] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:58 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:59.356708 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a5124445-e0f9-4842-90ca-f47375018323 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:59.357261 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a5124445-e0f9-4842-90ca-f47375018323 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:59.365139 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a5124445-e0f9-4842-90ca-f47375018323 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:59.365638 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a5124445-e0f9-4842-90ca-f47375018323 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:59.366081 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a5124445-e0f9-4842-90ca-f47375018323 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:59.366995 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a5124445-e0f9-4842-90ca-f47375018323 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:59.367619 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a5124445-e0f9-4842-90ca-f47375018323 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:59.368193 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a5124445-e0f9-4842-90ca-f47375018323 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:59.506711 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a5124445-e0f9-4842-90ca-f47375018323 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:07:59.514361 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a5124445-e0f9-4842-90ca-f47375018323 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1556 microversion: 2.1 time: 0.161836 Sep 23 14:07:59.514950 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 343/682] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:07:59 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:07:59.536820 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-0f636c05-862a-49b7-8288-e1fd2cc2563b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:07:59.537490 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-0f636c05-862a-49b7-8288-e1fd2cc2563b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:07:59.543845 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0f636c05-862a-49b7-8288-e1fd2cc2563b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:59.544322 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0f636c05-862a-49b7-8288-e1fd2cc2563b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:59.544839 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0f636c05-862a-49b7-8288-e1fd2cc2563b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:59.545529 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0f636c05-862a-49b7-8288-e1fd2cc2563b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:07:59.545982 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0f636c05-862a-49b7-8288-e1fd2cc2563b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:07:59.546431 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0f636c05-862a-49b7-8288-e1fd2cc2563b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:07:59.629392 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-0f636c05-862a-49b7-8288-e1fd2cc2563b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096739 Sep 23 14:07:59.629988 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 340/683] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 23 14:07:59 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:08:00.635295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-82e4fc65-4d8f-4b6e-82b0-ca9e1b246f68 req-732ca32d-30cf-4f3e-8406-e7bb1760ebed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eabc1ecf-db30-497e-ab52-807dbb0f9a09", "tag": "9f434098-b75f-420c-929f-b2ab8d58d384"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:08:00.646089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-82e4fc65-4d8f-4b6e-82b0-ca9e1b246f68 req-732ca32d-30cf-4f3e-8406-e7bb1760ebed service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:00.646606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-82e4fc65-4d8f-4b6e-82b0-ca9e1b246f68 req-732ca32d-30cf-4f3e-8406-e7bb1760ebed service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:00.647034 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-82e4fc65-4d8f-4b6e-82b0-ca9e1b246f68 req-732ca32d-30cf-4f3e-8406-e7bb1760ebed service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:00.658024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-82e4fc65-4d8f-4b6e-82b0-ca9e1b246f68 req-732ca32d-30cf-4f3e-8406-e7bb1760ebed service nova] Creating event network-changed:9f434098-b75f-420c-929f-b2ab8d58d384 for instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 on hv-cinder-85743 Sep 23 14:08:00.663438 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-82e4fc65-4d8f-4b6e-82b0-ca9e1b246f68 req-732ca32d-30cf-4f3e-8406-e7bb1760ebed service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031924 Sep 23 14:08:00.664441 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 344/684] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:08:29.413640 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=24 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:29.414440 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=84 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:29.418578 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-bb72c054-f9ee-46c4-bfc1-dd3d1c23eac6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:29.419100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-bb72c054-f9ee-46c4-bfc1-dd3d1c23eac6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:29.424909 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bb72c054-f9ee-46c4-bfc1-dd3d1c23eac6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:29.425618 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bb72c054-f9ee-46c4-bfc1-dd3d1c23eac6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:29.425898 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bb72c054-f9ee-46c4-bfc1-dd3d1c23eac6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:29.426637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bb72c054-f9ee-46c4-bfc1-dd3d1c23eac6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:29.427101 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bb72c054-f9ee-46c4-bfc1-dd3d1c23eac6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:29.428064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bb72c054-f9ee-46c4-bfc1-dd3d1c23eac6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:29.451854 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-bb72c054-f9ee-46c4-bfc1-dd3d1c23eac6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca/ips" status: 200 len: 152 microversion: 2.20 time: 0.040842 Sep 23 14:08:29.452419 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 341/685] 10.222.0.62 () {60 vars in 1289 bytes} [Fri Sep 23 14:08:29 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 14:08:31.793240 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6e9c4049-d5a0-4f0c-bce9-f9eca2b329cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:08:31.793626 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6e9c4049-d5a0-4f0c-bce9-f9eca2b329cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:31.795517 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=9 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:31.796167 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=24 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:31.801042 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e9c4049-d5a0-4f0c-bce9-f9eca2b329cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:31.801526 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e9c4049-d5a0-4f0c-bce9-f9eca2b329cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:31.801961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e9c4049-d5a0-4f0c-bce9-f9eca2b329cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:31.806967 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e9c4049-d5a0-4f0c-bce9-f9eca2b329cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:31.806967 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e9c4049-d5a0-4f0c-bce9-f9eca2b329cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:31.806967 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e9c4049-d5a0-4f0c-bce9-f9eca2b329cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:31.827355 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-6e9c4049-d5a0-4f0c-bce9-f9eca2b329cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lazy-loading 'flavor' on Instance uuid c49eff20-f8a6-404b-b09c-def6e4c167ca {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:08:32.227955 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6e9c4049-d5a0-4f0c-bce9-f9eca2b329cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "POST /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca/action" status: 202 len: 0 microversion: 2.20 time: 0.439303 Sep 23 14:08:32.228579 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 345/686] 10.222.0.62 () {62 vars in 1319 bytes} [Fri Sep 23 14:08:31 2022] POST /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:08:32.237099 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f4368b77-ed19-4a3e-aeeb-1a48dcb1ee2a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:32.237901 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f4368b77-ed19-4a3e-aeeb-1a48dcb1ee2a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:32.244775 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4368b77-ed19-4a3e-aeeb-1a48dcb1ee2a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:32.245270 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4368b77-ed19-4a3e-aeeb-1a48dcb1ee2a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:32.245708 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4368b77-ed19-4a3e-aeeb-1a48dcb1ee2a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:32.246434 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4368b77-ed19-4a3e-aeeb-1a48dcb1ee2a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:32.246914 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4368b77-ed19-4a3e-aeeb-1a48dcb1ee2a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:32.247383 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f4368b77-ed19-4a3e-aeeb-1a48dcb1ee2a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:32.385883 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f4368b77-ed19-4a3e-aeeb-1a48dcb1ee2a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:32.394387 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f4368b77-ed19-4a3e-aeeb-1a48dcb1ee2a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:32.395859 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f4368b77-ed19-4a3e-aeeb-1a48dcb1ee2a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:32.397929 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f4368b77-ed19-4a3e-aeeb-1a48dcb1ee2a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1723 microversion: 2.20 time: 0.165047 Sep 23 14:08:32.398512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 342/687] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:32 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:33.430814 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e0b4b14b-ac4a-4419-8b77-fea3c2e4d697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:33.431586 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e0b4b14b-ac4a-4419-8b77-fea3c2e4d697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:33.438024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e0b4b14b-ac4a-4419-8b77-fea3c2e4d697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:33.438563 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e0b4b14b-ac4a-4419-8b77-fea3c2e4d697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:33.439003 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e0b4b14b-ac4a-4419-8b77-fea3c2e4d697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:33.439730 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e0b4b14b-ac4a-4419-8b77-fea3c2e4d697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:33.440190 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e0b4b14b-ac4a-4419-8b77-fea3c2e4d697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:33.440623 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e0b4b14b-ac4a-4419-8b77-fea3c2e4d697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:33.578084 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e0b4b14b-ac4a-4419-8b77-fea3c2e4d697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:33.586289 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e0b4b14b-ac4a-4419-8b77-fea3c2e4d697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:33.587821 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e0b4b14b-ac4a-4419-8b77-fea3c2e4d697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:33.589039 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e0b4b14b-ac4a-4419-8b77-fea3c2e4d697 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1723 microversion: 2.20 time: 0.163718 Sep 23 14:08:33.589593 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 346/688] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:33 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:34.616673 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-aafecc38-6829-4b66-9ece-457229519bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:34.617281 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-aafecc38-6829-4b66-9ece-457229519bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:34.623645 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aafecc38-6829-4b66-9ece-457229519bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:34.624196 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aafecc38-6829-4b66-9ece-457229519bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:34.624667 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aafecc38-6829-4b66-9ece-457229519bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:34.625358 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aafecc38-6829-4b66-9ece-457229519bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:34.625815 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aafecc38-6829-4b66-9ece-457229519bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:34.626241 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aafecc38-6829-4b66-9ece-457229519bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:34.757495 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-aafecc38-6829-4b66-9ece-457229519bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:34.765524 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-aafecc38-6829-4b66-9ece-457229519bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:34.766991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-aafecc38-6829-4b66-9ece-457229519bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:34.768149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-aafecc38-6829-4b66-9ece-457229519bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1723 microversion: 2.20 time: 0.156311 Sep 23 14:08:34.768710 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 343/689] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:34 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:35.793668 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-dde6692c-d38e-4b83-9121-da0067c19a79 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:35.794281 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-dde6692c-d38e-4b83-9121-da0067c19a79 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:35.800315 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dde6692c-d38e-4b83-9121-da0067c19a79 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:35.800806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dde6692c-d38e-4b83-9121-da0067c19a79 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:35.801257 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dde6692c-d38e-4b83-9121-da0067c19a79 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:35.801951 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dde6692c-d38e-4b83-9121-da0067c19a79 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:35.803086 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dde6692c-d38e-4b83-9121-da0067c19a79 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:35.803675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-dde6692c-d38e-4b83-9121-da0067c19a79 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:35.935361 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-dde6692c-d38e-4b83-9121-da0067c19a79 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:35.944972 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-dde6692c-d38e-4b83-9121-da0067c19a79 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:35.946453 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-dde6692c-d38e-4b83-9121-da0067c19a79 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:35.947618 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-dde6692c-d38e-4b83-9121-da0067c19a79 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1723 microversion: 2.20 time: 0.157787 Sep 23 14:08:35.948181 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 347/690] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:35 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:36.973520 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f32a73f9-2307-4985-995a-85f4b9298dea tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:36.974128 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f32a73f9-2307-4985-995a-85f4b9298dea tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:36.980619 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f32a73f9-2307-4985-995a-85f4b9298dea tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:36.981106 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f32a73f9-2307-4985-995a-85f4b9298dea tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:36.981585 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f32a73f9-2307-4985-995a-85f4b9298dea tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:36.982294 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f32a73f9-2307-4985-995a-85f4b9298dea tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:36.982769 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f32a73f9-2307-4985-995a-85f4b9298dea tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:36.983196 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f32a73f9-2307-4985-995a-85f4b9298dea tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:37.114237 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f32a73f9-2307-4985-995a-85f4b9298dea tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:37.124177 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f32a73f9-2307-4985-995a-85f4b9298dea tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:37.125776 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f32a73f9-2307-4985-995a-85f4b9298dea tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:37.126988 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f32a73f9-2307-4985-995a-85f4b9298dea tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1723 microversion: 2.20 time: 0.157386 Sep 23 14:08:37.127577 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 344/691] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:36 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:38.153069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7c155eb6-3fc0-447e-bdde-151a65c10164 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:38.153673 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7c155eb6-3fc0-447e-bdde-151a65c10164 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:38.159760 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7c155eb6-3fc0-447e-bdde-151a65c10164 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:38.160241 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7c155eb6-3fc0-447e-bdde-151a65c10164 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:38.160676 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7c155eb6-3fc0-447e-bdde-151a65c10164 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:38.161409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7c155eb6-3fc0-447e-bdde-151a65c10164 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:38.161893 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7c155eb6-3fc0-447e-bdde-151a65c10164 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:38.162321 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7c155eb6-3fc0-447e-bdde-151a65c10164 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:38.303066 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7c155eb6-3fc0-447e-bdde-151a65c10164 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:38.312533 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7c155eb6-3fc0-447e-bdde-151a65c10164 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:38.314088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7c155eb6-3fc0-447e-bdde-151a65c10164 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:38.315299 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7c155eb6-3fc0-447e-bdde-151a65c10164 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1723 microversion: 2.20 time: 0.166190 Sep 23 14:08:38.315864 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 348/692] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:38 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:39.341454 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b93f2f7a-549f-4858-8617-5f2623f807e3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:39.342068 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b93f2f7a-549f-4858-8617-5f2623f807e3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:39.348443 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b93f2f7a-549f-4858-8617-5f2623f807e3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:39.348934 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b93f2f7a-549f-4858-8617-5f2623f807e3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:39.349448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b93f2f7a-549f-4858-8617-5f2623f807e3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:39.350760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b93f2f7a-549f-4858-8617-5f2623f807e3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:39.351230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b93f2f7a-549f-4858-8617-5f2623f807e3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:39.351663 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b93f2f7a-549f-4858-8617-5f2623f807e3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:39.489252 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b93f2f7a-549f-4858-8617-5f2623f807e3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:39.498750 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b93f2f7a-549f-4858-8617-5f2623f807e3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:39.500352 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b93f2f7a-549f-4858-8617-5f2623f807e3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:39.501515 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b93f2f7a-549f-4858-8617-5f2623f807e3 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1723 microversion: 2.20 time: 0.163993 Sep 23 14:08:39.502073 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 345/693] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:39 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:40.202865 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-cecd39c3-32eb-4186-88cf-a28e227e1e23 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:08:40.204007 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-cecd39c3-32eb-4186-88cf-a28e227e1e23 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:40.211562 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cecd39c3-32eb-4186-88cf-a28e227e1e23 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:40.212057 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cecd39c3-32eb-4186-88cf-a28e227e1e23 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:40.212498 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cecd39c3-32eb-4186-88cf-a28e227e1e23 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:40.213277 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cecd39c3-32eb-4186-88cf-a28e227e1e23 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:40.213745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cecd39c3-32eb-4186-88cf-a28e227e1e23 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:40.214180 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cecd39c3-32eb-4186-88cf-a28e227e1e23 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:40.237664 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-cecd39c3-32eb-4186-88cf-a28e227e1e23 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lazy-loading 'flavor' on Instance uuid ae3cf38f-b2d0-465c-9f91-7b04e669be1a {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:08:40.527238 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-76b6074a-ec26-45f0-a281-3bb7c83a381f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:40.527854 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-76b6074a-ec26-45f0-a281-3bb7c83a381f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:40.534192 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-76b6074a-ec26-45f0-a281-3bb7c83a381f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:40.534712 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-76b6074a-ec26-45f0-a281-3bb7c83a381f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:40.535157 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-76b6074a-ec26-45f0-a281-3bb7c83a381f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:40.535900 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-76b6074a-ec26-45f0-a281-3bb7c83a381f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:40.536326 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-76b6074a-ec26-45f0-a281-3bb7c83a381f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:40.536757 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-76b6074a-ec26-45f0-a281-3bb7c83a381f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:40.539902 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-cecd39c3-32eb-4186-88cf-a28e227e1e23 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "POST /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a/action" status: 202 len: 0 microversion: 2.1 time: 0.341070 Sep 23 14:08:40.541897 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 349/694] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 23 14:08:40 2022] POST /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:08:40.549145 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-639b12db-0907-4a28-b1f0-e550c1867da9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:40.549934 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-639b12db-0907-4a28-b1f0-e550c1867da9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:40.557071 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-639b12db-0907-4a28-b1f0-e550c1867da9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:40.557677 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-639b12db-0907-4a28-b1f0-e550c1867da9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:40.558112 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-639b12db-0907-4a28-b1f0-e550c1867da9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:40.558846 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-639b12db-0907-4a28-b1f0-e550c1867da9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:40.559304 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-639b12db-0907-4a28-b1f0-e550c1867da9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:40.559725 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-639b12db-0907-4a28-b1f0-e550c1867da9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:40.723546 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-76b6074a-ec26-45f0-a281-3bb7c83a381f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:40.732026 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-76b6074a-ec26-45f0-a281-3bb7c83a381f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:40.733671 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-76b6074a-ec26-45f0-a281-3bb7c83a381f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:40.734855 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-76b6074a-ec26-45f0-a281-3bb7c83a381f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1723 microversion: 2.20 time: 0.211575 Sep 23 14:08:40.735409 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 346/695] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:40 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:08:40.748084 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-639b12db-0907-4a28-b1f0-e550c1867da9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:40.762135 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-639b12db-0907-4a28-b1f0-e550c1867da9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.211832 Sep 23 14:08:40.762135 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 350/696] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:40 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:08:41.761596 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4c13ef41-9309-4ed2-b312-0337441738c7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:41.766754 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4c13ef41-9309-4ed2-b312-0337441738c7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:41.769070 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c13ef41-9309-4ed2-b312-0337441738c7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:41.769559 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c13ef41-9309-4ed2-b312-0337441738c7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:41.769992 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c13ef41-9309-4ed2-b312-0337441738c7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:41.770716 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c13ef41-9309-4ed2-b312-0337441738c7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:41.771181 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c13ef41-9309-4ed2-b312-0337441738c7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:41.772206 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4c13ef41-9309-4ed2-b312-0337441738c7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:41.784815 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-444feb70-bfe2-4bec-a37c-2077bc3e05ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:41.786417 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-444feb70-bfe2-4bec-a37c-2077bc3e05ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:41.794600 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-444feb70-bfe2-4bec-a37c-2077bc3e05ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:41.795613 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-444feb70-bfe2-4bec-a37c-2077bc3e05ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:41.796321 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-444feb70-bfe2-4bec-a37c-2077bc3e05ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:41.797387 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-444feb70-bfe2-4bec-a37c-2077bc3e05ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:41.798205 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-444feb70-bfe2-4bec-a37c-2077bc3e05ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:41.799061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-444feb70-bfe2-4bec-a37c-2077bc3e05ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:41.989814 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4c13ef41-9309-4ed2-b312-0337441738c7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:41.994609 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-444feb70-bfe2-4bec-a37c-2077bc3e05ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:42.000486 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4c13ef41-9309-4ed2-b312-0337441738c7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:42.001975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4c13ef41-9309-4ed2-b312-0337441738c7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:42.002757 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-444feb70-bfe2-4bec-a37c-2077bc3e05ba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.222860 Sep 23 14:08:42.003149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4c13ef41-9309-4ed2-b312-0337441738c7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1723 microversion: 2.20 time: 0.245377 Sep 23 14:08:42.003604 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 351/697] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:41 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:08:42.003846 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 347/698] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:41 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:08:43.026675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ef65054a-42ec-4b47-b091-f3ff40145f98 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:43.027289 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ef65054a-42ec-4b47-b091-f3ff40145f98 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:43.029000 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f644c79f-d4b7-4ea8-b955-4978b801f5fe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:43.029696 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f644c79f-d4b7-4ea8-b955-4978b801f5fe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:43.033221 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ef65054a-42ec-4b47-b091-f3ff40145f98 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:43.033704 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ef65054a-42ec-4b47-b091-f3ff40145f98 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:43.034137 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ef65054a-42ec-4b47-b091-f3ff40145f98 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:43.034906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ef65054a-42ec-4b47-b091-f3ff40145f98 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:43.035342 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ef65054a-42ec-4b47-b091-f3ff40145f98 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:43.035763 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ef65054a-42ec-4b47-b091-f3ff40145f98 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:43.036072 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f644c79f-d4b7-4ea8-b955-4978b801f5fe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:43.036532 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f644c79f-d4b7-4ea8-b955-4978b801f5fe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:43.037269 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f644c79f-d4b7-4ea8-b955-4978b801f5fe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:43.037966 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f644c79f-d4b7-4ea8-b955-4978b801f5fe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:43.038442 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f644c79f-d4b7-4ea8-b955-4978b801f5fe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:43.039034 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f644c79f-d4b7-4ea8-b955-4978b801f5fe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:43.245392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ef65054a-42ec-4b47-b091-f3ff40145f98 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:43.249414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f644c79f-d4b7-4ea8-b955-4978b801f5fe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:43.253236 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ef65054a-42ec-4b47-b091-f3ff40145f98 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.230368 Sep 23 14:08:43.253813 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 352/699] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:43 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:08:43.258322 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f644c79f-d4b7-4ea8-b955-4978b801f5fe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:43.259798 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f644c79f-d4b7-4ea8-b955-4978b801f5fe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:43.260953 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f644c79f-d4b7-4ea8-b955-4978b801f5fe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1744 microversion: 2.20 time: 0.235871 Sep 23 14:08:43.261522 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 348/700] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:43 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1744 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:08:44.278301 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ece03d88-b3a6-4703-a4c5-7ff24ab13b1c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:44.309767 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ece03d88-b3a6-4703-a4c5-7ff24ab13b1c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:44.309767 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ece03d88-b3a6-4703-a4c5-7ff24ab13b1c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:44.309767 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ece03d88-b3a6-4703-a4c5-7ff24ab13b1c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:44.309767 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ece03d88-b3a6-4703-a4c5-7ff24ab13b1c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:44.310473 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ece03d88-b3a6-4703-a4c5-7ff24ab13b1c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:44.310473 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ece03d88-b3a6-4703-a4c5-7ff24ab13b1c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:44.310473 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ece03d88-b3a6-4703-a4c5-7ff24ab13b1c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:44.310738 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-85b2d2ca-e466-49ec-8939-c5bdbc9a7c0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:44.310738 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-85b2d2ca-e466-49ec-8939-c5bdbc9a7c0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:44.310738 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85b2d2ca-e466-49ec-8939-c5bdbc9a7c0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:44.310738 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85b2d2ca-e466-49ec-8939-c5bdbc9a7c0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:44.311472 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85b2d2ca-e466-49ec-8939-c5bdbc9a7c0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:44.311472 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85b2d2ca-e466-49ec-8939-c5bdbc9a7c0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:44.311472 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85b2d2ca-e466-49ec-8939-c5bdbc9a7c0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:44.311472 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-85b2d2ca-e466-49ec-8939-c5bdbc9a7c0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:44.499442 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ece03d88-b3a6-4703-a4c5-7ff24ab13b1c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:44.503621 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-85b2d2ca-e466-49ec-8939-c5bdbc9a7c0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:44.507141 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ece03d88-b3a6-4703-a4c5-7ff24ab13b1c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.233054 Sep 23 14:08:44.508202 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 353/701] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:44 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:08:44.512912 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-129b78e3-2730-41c0-a6e6-8cc2e4457d08 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:44.513093 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-85b2d2ca-e466-49ec-8939-c5bdbc9a7c0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:44.513754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-129b78e3-2730-41c0-a6e6-8cc2e4457d08 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:44.514691 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-85b2d2ca-e466-49ec-8939-c5bdbc9a7c0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:44.516278 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-85b2d2ca-e466-49ec-8939-c5bdbc9a7c0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1744 microversion: 2.20 time: 0.231168 Sep 23 14:08:44.526927 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 349/702] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:44 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1744 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:44.527085 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-129b78e3-2730-41c0-a6e6-8cc2e4457d08 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:44.527085 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-129b78e3-2730-41c0-a6e6-8cc2e4457d08 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:44.527085 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-129b78e3-2730-41c0-a6e6-8cc2e4457d08 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:44.527085 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-129b78e3-2730-41c0-a6e6-8cc2e4457d08 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:44.527390 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-129b78e3-2730-41c0-a6e6-8cc2e4457d08 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:44.527390 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-129b78e3-2730-41c0-a6e6-8cc2e4457d08 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:44.547571 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-129b78e3-2730-41c0-a6e6-8cc2e4457d08 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09/ips" status: 200 len: 150 microversion: 2.1 time: 0.038365 Sep 23 14:08:44.548137 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 354/703] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 23 14:08:44 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:08:45.532324 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9d8318d8-2017-4c04-a7ca-85ffa4949ff3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:45.532930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9d8318d8-2017-4c04-a7ca-85ffa4949ff3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:45.540561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d8318d8-2017-4c04-a7ca-85ffa4949ff3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:45.540950 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d8318d8-2017-4c04-a7ca-85ffa4949ff3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:45.541498 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d8318d8-2017-4c04-a7ca-85ffa4949ff3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:45.542192 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d8318d8-2017-4c04-a7ca-85ffa4949ff3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:45.542668 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d8318d8-2017-4c04-a7ca-85ffa4949ff3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:45.543090 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d8318d8-2017-4c04-a7ca-85ffa4949ff3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:45.544659 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e21c351c-12fa-4f35-bca0-4d495cdb3cd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:45.545586 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e21c351c-12fa-4f35-bca0-4d495cdb3cd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:45.551486 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e21c351c-12fa-4f35-bca0-4d495cdb3cd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:45.551977 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e21c351c-12fa-4f35-bca0-4d495cdb3cd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:45.552527 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e21c351c-12fa-4f35-bca0-4d495cdb3cd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:45.553244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e21c351c-12fa-4f35-bca0-4d495cdb3cd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:45.553704 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e21c351c-12fa-4f35-bca0-4d495cdb3cd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:45.554130 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e21c351c-12fa-4f35-bca0-4d495cdb3cd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:45.759626 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9d8318d8-2017-4c04-a7ca-85ffa4949ff3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:45.762191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e21c351c-12fa-4f35-bca0-4d495cdb3cd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:45.769640 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9d8318d8-2017-4c04-a7ca-85ffa4949ff3 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.241224 Sep 23 14:08:45.770220 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 350/704] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:45 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:08:45.786615 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e21c351c-12fa-4f35-bca0-4d495cdb3cd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:45.786615 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e21c351c-12fa-4f35-bca0-4d495cdb3cd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:45.786615 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e21c351c-12fa-4f35-bca0-4d495cdb3cd4 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1744 microversion: 2.20 time: 0.232738 Sep 23 14:08:45.786931 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 355/705] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:45 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1744 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:08:46.198017 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8c934e6a-dbb2-4eba-9fad-33109e86c926 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edafab1d-cbf3-4be8-b3bc-4860dda5927e"}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:08:46.202587 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-8c934e6a-dbb2-4eba-9fad-33109e86c926 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:46.206636 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8c934e6a-dbb2-4eba-9fad-33109e86c926 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:46.207144 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8c934e6a-dbb2-4eba-9fad-33109e86c926 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:46.207558 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8c934e6a-dbb2-4eba-9fad-33109e86c926 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:46.208241 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8c934e6a-dbb2-4eba-9fad-33109e86c926 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:46.208695 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8c934e6a-dbb2-4eba-9fad-33109e86c926 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:46.209119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8c934e6a-dbb2-4eba-9fad-33109e86c926 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:46.794881 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7471573a-e3b6-4c29-b9d0-b595ead8c860 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:46.796330 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7471573a-e3b6-4c29-b9d0-b595ead8c860 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:46.827040 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7471573a-e3b6-4c29-b9d0-b595ead8c860 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:46.827726 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7471573a-e3b6-4c29-b9d0-b595ead8c860 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:46.828184 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7471573a-e3b6-4c29-b9d0-b595ead8c860 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:46.828929 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7471573a-e3b6-4c29-b9d0-b595ead8c860 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:46.829385 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7471573a-e3b6-4c29-b9d0-b595ead8c860 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:46.833102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7471573a-e3b6-4c29-b9d0-b595ead8c860 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:47.005626 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7471573a-e3b6-4c29-b9d0-b595ead8c860 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:47.014486 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7471573a-e3b6-4c29-b9d0-b595ead8c860 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.224573 Sep 23 14:08:47.026678 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 356/706] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:46 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:08:47.036074 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b42905f7-a523-4a5c-99d2-83eb18a9304b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:47.041684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b42905f7-a523-4a5c-99d2-83eb18a9304b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:47.043458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b42905f7-a523-4a5c-99d2-83eb18a9304b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:47.044141 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b42905f7-a523-4a5c-99d2-83eb18a9304b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:47.044571 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b42905f7-a523-4a5c-99d2-83eb18a9304b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:47.045262 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b42905f7-a523-4a5c-99d2-83eb18a9304b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:47.045712 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b42905f7-a523-4a5c-99d2-83eb18a9304b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:47.046131 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b42905f7-a523-4a5c-99d2-83eb18a9304b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:47.125061 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8c934e6a-dbb2-4eba-9fad-33109e86c926 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "POST /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.931130 Sep 23 14:08:47.130730 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 351/707] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 23 14:08:46 2022] POST /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09/os-volume_attachments => generated 194 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:08:47.256010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b42905f7-a523-4a5c-99d2-83eb18a9304b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:47.260913 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:47.267425 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b42905f7-a523-4a5c-99d2-83eb18a9304b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:47.269146 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b42905f7-a523-4a5c-99d2-83eb18a9304b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:47.270569 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b42905f7-a523-4a5c-99d2-83eb18a9304b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1739 microversion: 2.20 time: 0.242866 Sep 23 14:08:47.271904 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 357/708] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:47 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:47.401003 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-2bb24b56-55bb-4149-837d-4e3d27034c57 req-f01cf5b6-11dd-496a-a3ad-4cac40587dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49eff20-f8a6-404b-b09c-def6e4c167ca", "name": "network-vif-plugged", "status": "completed", "tag": "20043706-94ae-416a-96d1-e1f2fc14183b"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:08:47.415184 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2bb24b56-55bb-4149-837d-4e3d27034c57 req-f01cf5b6-11dd-496a-a3ad-4cac40587dd9 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:47.415677 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2bb24b56-55bb-4149-837d-4e3d27034c57 req-f01cf5b6-11dd-496a-a3ad-4cac40587dd9 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:47.416749 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2bb24b56-55bb-4149-837d-4e3d27034c57 req-f01cf5b6-11dd-496a-a3ad-4cac40587dd9 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:47.428585 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-2bb24b56-55bb-4149-837d-4e3d27034c57 req-f01cf5b6-11dd-496a-a3ad-4cac40587dd9 service nova] Creating event network-vif-plugged:20043706-94ae-416a-96d1-e1f2fc14183b for instance c49eff20-f8a6-404b-b09c-def6e4c167ca on hv-cinder-85743 Sep 23 14:08:47.435594 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-2bb24b56-55bb-4149-837d-4e3d27034c57 req-f01cf5b6-11dd-496a-a3ad-4cac40587dd9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039195 Sep 23 14:08:47.436874 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 352/709] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:08:48.043311 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7ac1aa1e-d0ab-4599-b80e-32b8ba9da761 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:48.044711 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7ac1aa1e-d0ab-4599-b80e-32b8ba9da761 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:48.054008 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ac1aa1e-d0ab-4599-b80e-32b8ba9da761 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:48.054608 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ac1aa1e-d0ab-4599-b80e-32b8ba9da761 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:48.055425 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ac1aa1e-d0ab-4599-b80e-32b8ba9da761 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:48.056224 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ac1aa1e-d0ab-4599-b80e-32b8ba9da761 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:48.058173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ac1aa1e-d0ab-4599-b80e-32b8ba9da761 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:48.058734 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ac1aa1e-d0ab-4599-b80e-32b8ba9da761 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:48.218348 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7ac1aa1e-d0ab-4599-b80e-32b8ba9da761 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:48.231929 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7ac1aa1e-d0ab-4599-b80e-32b8ba9da761 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.194034 Sep 23 14:08:48.232723 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 358/710] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:48 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:08:48.504313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-50bf39da-2b76-4e31-9ad6-bdd5d3280bbe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:48.505597 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-50bf39da-2b76-4e31-9ad6-bdd5d3280bbe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:48.513162 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-50bf39da-2b76-4e31-9ad6-bdd5d3280bbe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:48.513654 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-50bf39da-2b76-4e31-9ad6-bdd5d3280bbe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:48.514086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-50bf39da-2b76-4e31-9ad6-bdd5d3280bbe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:48.515091 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-50bf39da-2b76-4e31-9ad6-bdd5d3280bbe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:48.515548 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-50bf39da-2b76-4e31-9ad6-bdd5d3280bbe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:48.520309 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-50bf39da-2b76-4e31-9ad6-bdd5d3280bbe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:48.667991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-50bf39da-2b76-4e31-9ad6-bdd5d3280bbe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:48.677601 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-50bf39da-2b76-4e31-9ad6-bdd5d3280bbe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:48.679818 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-50bf39da-2b76-4e31-9ad6-bdd5d3280bbe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:48.682498 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-50bf39da-2b76-4e31-9ad6-bdd5d3280bbe tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1739 microversion: 2.20 time: 0.385116 Sep 23 14:08:48.683719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 353/711] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:48 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1739 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:49.260275 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a16d4b09-23ba-404d-b89d-28eef3f30721 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:49.261055 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a16d4b09-23ba-404d-b89d-28eef3f30721 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:49.267633 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a16d4b09-23ba-404d-b89d-28eef3f30721 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:49.268475 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a16d4b09-23ba-404d-b89d-28eef3f30721 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:49.269185 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a16d4b09-23ba-404d-b89d-28eef3f30721 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:49.270143 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a16d4b09-23ba-404d-b89d-28eef3f30721 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:49.270945 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a16d4b09-23ba-404d-b89d-28eef3f30721 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:49.271604 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a16d4b09-23ba-404d-b89d-28eef3f30721 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:49.450908 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a16d4b09-23ba-404d-b89d-28eef3f30721 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:49.459067 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a16d4b09-23ba-404d-b89d-28eef3f30721 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.203009 Sep 23 14:08:49.459671 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 359/712] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:49 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:08:49.709388 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c13518e5-46c7-4631-aa9d-d7cb97c34334 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:49.711558 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c13518e5-46c7-4631-aa9d-d7cb97c34334 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:49.717640 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c13518e5-46c7-4631-aa9d-d7cb97c34334 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:49.718158 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c13518e5-46c7-4631-aa9d-d7cb97c34334 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:49.718631 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c13518e5-46c7-4631-aa9d-d7cb97c34334 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:49.719373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c13518e5-46c7-4631-aa9d-d7cb97c34334 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:49.719831 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c13518e5-46c7-4631-aa9d-d7cb97c34334 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:49.720258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c13518e5-46c7-4631-aa9d-d7cb97c34334 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:49.862778 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c13518e5-46c7-4631-aa9d-d7cb97c34334 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:49.870897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c13518e5-46c7-4631-aa9d-d7cb97c34334 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:49.872327 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c13518e5-46c7-4631-aa9d-d7cb97c34334 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:49.873482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c13518e5-46c7-4631-aa9d-d7cb97c34334 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1739 microversion: 2.20 time: 0.168287 Sep 23 14:08:49.874042 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 354/713] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:49 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:50.484127 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b0f61479-3cc5-466d-881e-516bb775e6b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:50.484847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b0f61479-3cc5-466d-881e-516bb775e6b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:50.498662 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b0f61479-3cc5-466d-881e-516bb775e6b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:50.499502 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b0f61479-3cc5-466d-881e-516bb775e6b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:50.500502 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b0f61479-3cc5-466d-881e-516bb775e6b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:50.501433 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b0f61479-3cc5-466d-881e-516bb775e6b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:50.502097 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b0f61479-3cc5-466d-881e-516bb775e6b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:50.502753 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b0f61479-3cc5-466d-881e-516bb775e6b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:50.680111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b0f61479-3cc5-466d-881e-516bb775e6b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:50.693720 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b0f61479-3cc5-466d-881e-516bb775e6b8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.212401 Sep 23 14:08:50.696184 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 360/714] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:50 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:08:50.901441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-596d7a3a-c55f-453c-b492-8246fe71f920 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:50.902811 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-596d7a3a-c55f-453c-b492-8246fe71f920 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:50.910955 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-596d7a3a-c55f-453c-b492-8246fe71f920 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:50.911637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-596d7a3a-c55f-453c-b492-8246fe71f920 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:50.915816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-596d7a3a-c55f-453c-b492-8246fe71f920 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:50.915816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-596d7a3a-c55f-453c-b492-8246fe71f920 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:50.915816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-596d7a3a-c55f-453c-b492-8246fe71f920 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:50.915816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-596d7a3a-c55f-453c-b492-8246fe71f920 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:51.165762 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-596d7a3a-c55f-453c-b492-8246fe71f920 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:51.176787 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-596d7a3a-c55f-453c-b492-8246fe71f920 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:51.178550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-596d7a3a-c55f-453c-b492-8246fe71f920 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:51.180018 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-596d7a3a-c55f-453c-b492-8246fe71f920 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1739 microversion: 2.20 time: 0.284273 Sep 23 14:08:51.180901 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 355/715] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:50 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:51.721657 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e316aef1-e224-43cf-b3ef-12724934e4e6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:51.721657 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e316aef1-e224-43cf-b3ef-12724934e4e6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:51.726474 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e316aef1-e224-43cf-b3ef-12724934e4e6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:51.727139 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e316aef1-e224-43cf-b3ef-12724934e4e6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:51.728232 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e316aef1-e224-43cf-b3ef-12724934e4e6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:51.731004 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e316aef1-e224-43cf-b3ef-12724934e4e6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:51.731885 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e316aef1-e224-43cf-b3ef-12724934e4e6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:51.732477 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e316aef1-e224-43cf-b3ef-12724934e4e6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:51.914989 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e316aef1-e224-43cf-b3ef-12724934e4e6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:51.925408 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e316aef1-e224-43cf-b3ef-12724934e4e6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.209530 Sep 23 14:08:51.941108 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 361/716] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:51 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:08:52.211596 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f0678cc1-5c66-4151-98d2-1e29c23dba1a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:52.212972 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f0678cc1-5c66-4151-98d2-1e29c23dba1a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:52.220816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f0678cc1-5c66-4151-98d2-1e29c23dba1a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:52.221677 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f0678cc1-5c66-4151-98d2-1e29c23dba1a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:52.222137 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f0678cc1-5c66-4151-98d2-1e29c23dba1a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:52.222968 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f0678cc1-5c66-4151-98d2-1e29c23dba1a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:52.223716 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f0678cc1-5c66-4151-98d2-1e29c23dba1a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:52.224404 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f0678cc1-5c66-4151-98d2-1e29c23dba1a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:52.384991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f0678cc1-5c66-4151-98d2-1e29c23dba1a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:52.394111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f0678cc1-5c66-4151-98d2-1e29c23dba1a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:52.396492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f0678cc1-5c66-4151-98d2-1e29c23dba1a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:52.398355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f0678cc1-5c66-4151-98d2-1e29c23dba1a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1739 microversion: 2.20 time: 0.190541 Sep 23 14:08:52.409917 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 356/717] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:52 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:52.951938 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-c5d31263-ee91-4d38-9ccb-36515b1e08cf tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:52.952746 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-c5d31263-ee91-4d38-9ccb-36515b1e08cf tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:52.959509 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c5d31263-ee91-4d38-9ccb-36515b1e08cf tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:52.960004 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c5d31263-ee91-4d38-9ccb-36515b1e08cf tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:52.960466 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c5d31263-ee91-4d38-9ccb-36515b1e08cf tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:52.961174 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c5d31263-ee91-4d38-9ccb-36515b1e08cf tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:52.961663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c5d31263-ee91-4d38-9ccb-36515b1e08cf tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:52.962169 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c5d31263-ee91-4d38-9ccb-36515b1e08cf tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:53.106361 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-c5d31263-ee91-4d38-9ccb-36515b1e08cf tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:53.114660 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-c5d31263-ee91-4d38-9ccb-36515b1e08cf tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.166596 Sep 23 14:08:53.115236 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 362/718] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:52 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:08:53.427805 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-fc5c8cb5-757e-4493-88a6-eff1a2dd80dd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:53.428532 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-fc5c8cb5-757e-4493-88a6-eff1a2dd80dd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:53.438249 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fc5c8cb5-757e-4493-88a6-eff1a2dd80dd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:53.438870 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fc5c8cb5-757e-4493-88a6-eff1a2dd80dd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:53.440645 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fc5c8cb5-757e-4493-88a6-eff1a2dd80dd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:53.441493 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fc5c8cb5-757e-4493-88a6-eff1a2dd80dd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:53.442025 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fc5c8cb5-757e-4493-88a6-eff1a2dd80dd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:53.442672 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-fc5c8cb5-757e-4493-88a6-eff1a2dd80dd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:53.449008 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:53.631026 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-fc5c8cb5-757e-4493-88a6-eff1a2dd80dd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:53.641146 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-fc5c8cb5-757e-4493-88a6-eff1a2dd80dd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:53.648011 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-fc5c8cb5-757e-4493-88a6-eff1a2dd80dd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:53.652292 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-fc5c8cb5-757e-4493-88a6-eff1a2dd80dd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1739 microversion: 2.20 time: 0.228327 Sep 23 14:08:53.654769 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 357/719] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:53 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:54.139179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-86c096ea-32e3-4ae8-9462-c1f57b4cbeb7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:54.139904 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-86c096ea-32e3-4ae8-9462-c1f57b4cbeb7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:54.146658 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-86c096ea-32e3-4ae8-9462-c1f57b4cbeb7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:54.147439 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-86c096ea-32e3-4ae8-9462-c1f57b4cbeb7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:54.147974 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-86c096ea-32e3-4ae8-9462-c1f57b4cbeb7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:54.149387 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-86c096ea-32e3-4ae8-9462-c1f57b4cbeb7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:54.150035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-86c096ea-32e3-4ae8-9462-c1f57b4cbeb7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:54.151167 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-86c096ea-32e3-4ae8-9462-c1f57b4cbeb7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:54.317087 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-86c096ea-32e3-4ae8-9462-c1f57b4cbeb7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:54.334371 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-86c096ea-32e3-4ae8-9462-c1f57b4cbeb7 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.200070 Sep 23 14:08:54.335309 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 363/720] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:54 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:08:54.679478 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-935bac98-e50c-4151-aa47-4e85000d4bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:54.680788 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-935bac98-e50c-4151-aa47-4e85000d4bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:54.690714 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-935bac98-e50c-4151-aa47-4e85000d4bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:54.691772 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-935bac98-e50c-4151-aa47-4e85000d4bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:54.692940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-935bac98-e50c-4151-aa47-4e85000d4bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:54.693704 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-935bac98-e50c-4151-aa47-4e85000d4bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:54.694230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-935bac98-e50c-4151-aa47-4e85000d4bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:54.694915 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-935bac98-e50c-4151-aa47-4e85000d4bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:54.930664 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-935bac98-e50c-4151-aa47-4e85000d4bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:54.937876 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-935bac98-e50c-4151-aa47-4e85000d4bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:54.941585 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-935bac98-e50c-4151-aa47-4e85000d4bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:54.951013 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-935bac98-e50c-4151-aa47-4e85000d4bc8 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1739 microversion: 2.20 time: 0.271650 Sep 23 14:08:54.980816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 358/721] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:54 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:08:55.358407 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0b55b341-cc0f-4db7-8aa9-6853f61e27d1 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:55.359888 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-0b55b341-cc0f-4db7-8aa9-6853f61e27d1 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:55.367105 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0b55b341-cc0f-4db7-8aa9-6853f61e27d1 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:55.367963 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0b55b341-cc0f-4db7-8aa9-6853f61e27d1 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:55.368470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0b55b341-cc0f-4db7-8aa9-6853f61e27d1 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:55.369887 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0b55b341-cc0f-4db7-8aa9-6853f61e27d1 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:55.370477 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0b55b341-cc0f-4db7-8aa9-6853f61e27d1 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:55.371043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0b55b341-cc0f-4db7-8aa9-6853f61e27d1 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:55.575949 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-0b55b341-cc0f-4db7-8aa9-6853f61e27d1 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:55.584258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-0b55b341-cc0f-4db7-8aa9-6853f61e27d1 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1569 microversion: 2.1 time: 0.230273 Sep 23 14:08:55.585111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 364/722] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:55 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:08:55.609059 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-96719de0-4d03-4169-ad4b-a53425c31185 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:08:55.609584 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-96719de0-4d03-4169-ad4b-a53425c31185 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:55.616902 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-96719de0-4d03-4169-ad4b-a53425c31185 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:55.617388 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-96719de0-4d03-4169-ad4b-a53425c31185 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:55.618115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-96719de0-4d03-4169-ad4b-a53425c31185 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:55.618917 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-96719de0-4d03-4169-ad4b-a53425c31185 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:55.621210 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-96719de0-4d03-4169-ad4b-a53425c31185 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:55.621644 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-96719de0-4d03-4169-ad4b-a53425c31185 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:55.680251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-96719de0-4d03-4169-ad4b-a53425c31185 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121073) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 14:08:55.987346 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e345d885-f998-4c99-939c-88f08c355be1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:55.991630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e345d885-f998-4c99-939c-88f08c355be1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:55.999326 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e345d885-f998-4c99-939c-88f08c355be1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:56.000088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e345d885-f998-4c99-939c-88f08c355be1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:56.000529 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e345d885-f998-4c99-939c-88f08c355be1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:56.001260 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e345d885-f998-4c99-939c-88f08c355be1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:56.001751 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e345d885-f998-4c99-939c-88f08c355be1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:56.002177 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e345d885-f998-4c99-939c-88f08c355be1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:56.020555 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-96719de0-4d03-4169-ad4b-a53425c31185 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "POST /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a/action" status: 202 len: 0 microversion: 2.1 time: 0.416654 Sep 23 14:08:56.022791 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 359/723] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 23 14:08:55 2022] POST /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 14:08:56.042236 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f360e09e-b008-4761-9493-4648cce25cfa tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:56.044123 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f360e09e-b008-4761-9493-4648cce25cfa tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:56.059757 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f360e09e-b008-4761-9493-4648cce25cfa tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:56.060285 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f360e09e-b008-4761-9493-4648cce25cfa tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:56.061991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f360e09e-b008-4761-9493-4648cce25cfa tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:56.062879 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f360e09e-b008-4761-9493-4648cce25cfa tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:56.064580 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f360e09e-b008-4761-9493-4648cce25cfa tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:56.065015 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f360e09e-b008-4761-9493-4648cce25cfa tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:56.366735 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e345d885-f998-4c99-939c-88f08c355be1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:56.370870 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f360e09e-b008-4761-9493-4648cce25cfa tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:56.380995 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e345d885-f998-4c99-939c-88f08c355be1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:56.385387 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e345d885-f998-4c99-939c-88f08c355be1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:56.391993 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f360e09e-b008-4761-9493-4648cce25cfa tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1517 microversion: 2.1 time: 0.362135 Sep 23 14:08:56.403276 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e345d885-f998-4c99-939c-88f08c355be1 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1739 microversion: 2.20 time: 0.419900 Sep 23 14:08:56.412071 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 360/724] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:56 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1517 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:08:56.418801 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 365/725] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:55 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1739 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:08:56.419475 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5226a700-5a73-4976-8cfb-5649170b4924 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:56.420078 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5226a700-5a73-4976-8cfb-5649170b4924 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:56.434097 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5226a700-5a73-4976-8cfb-5649170b4924 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:56.434850 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5226a700-5a73-4976-8cfb-5649170b4924 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:56.435565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5226a700-5a73-4976-8cfb-5649170b4924 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:56.436615 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5226a700-5a73-4976-8cfb-5649170b4924 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:56.437283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5226a700-5a73-4976-8cfb-5649170b4924 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:56.437912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5226a700-5a73-4976-8cfb-5649170b4924 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:56.548170 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-5226a700-5a73-4976-8cfb-5649170b4924 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lazy-loading 'services' on Instance uuid eabc1ecf-db30-497e-ab52-807dbb0f9a09 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:08:57.316663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-3076b630-7b6b-4884-bf66-508c70c5a5b8 req-ce1287d0-5bf5-494e-9198-8368fe5f9d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3cf38f-b2d0-465c-9f91-7b04e669be1a", "name": "network-vif-unplugged", "status": "completed", "tag": "ddb61f77-2e1f-4d02-bd20-42e3ca25c62d"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:08:57.318015 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5226a700-5a73-4976-8cfb-5649170b4924 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09/os-volume_attachments/edafab1d-cbf3-4be8-b3bc-4860dda5927e" status: 202 len: 0 microversion: 2.1 time: 0.904269 Sep 23 14:08:57.319234 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 361/726] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 23 14:08:56 2022] DELETE /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09/os-volume_attachments/edafab1d-cbf3-4be8-b3bc-4860dda5927e => generated 0 bytes in 906 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:08:57.327347 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-3076b630-7b6b-4884-bf66-508c70c5a5b8 req-ce1287d0-5bf5-494e-9198-8368fe5f9d47 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:57.327969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-3076b630-7b6b-4884-bf66-508c70c5a5b8 req-ce1287d0-5bf5-494e-9198-8368fe5f9d47 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:57.328580 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-3076b630-7b6b-4884-bf66-508c70c5a5b8 req-ce1287d0-5bf5-494e-9198-8368fe5f9d47 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:57.333151 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c2ec444d-a8d1-4033-89a5-30ad83b9d791 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:57.335895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c2ec444d-a8d1-4033-89a5-30ad83b9d791 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:57.342549 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.compute.server_external_events [req-3076b630-7b6b-4884-bf66-508c70c5a5b8 req-ce1287d0-5bf5-494e-9198-8368fe5f9d47 service nova] Unable to find a host for instance ae3cf38f-b2d0-465c-9f91-7b04e669be1a. Dropping event network-vif-unplugged {{(pid=121074) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 14:08:57.343853 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-3076b630-7b6b-4884-bf66-508c70c5a5b8 req-ce1287d0-5bf5-494e-9198-8368fe5f9d47 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031948 Sep 23 14:08:57.344473 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c2ec444d-a8d1-4033-89a5-30ad83b9d791 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:57.345166 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c2ec444d-a8d1-4033-89a5-30ad83b9d791 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:57.345409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 366/727] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 23 14:08:57.345987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c2ec444d-a8d1-4033-89a5-30ad83b9d791 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:57.347089 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c2ec444d-a8d1-4033-89a5-30ad83b9d791 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:57.347929 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c2ec444d-a8d1-4033-89a5-30ad83b9d791 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:57.348573 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c2ec444d-a8d1-4033-89a5-30ad83b9d791 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:57.407323 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c2ec444d-a8d1-4033-89a5-30ad83b9d791 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079505 Sep 23 14:08:57.414934 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 362/728] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:08:57 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:08:57.418947 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a84d007b-b287-4998-b4be-ebccd9e693a4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:57.419740 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a84d007b-b287-4998-b4be-ebccd9e693a4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:57.427775 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a84d007b-b287-4998-b4be-ebccd9e693a4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:57.427775 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a84d007b-b287-4998-b4be-ebccd9e693a4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:57.427775 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a84d007b-b287-4998-b4be-ebccd9e693a4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:57.427775 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a84d007b-b287-4998-b4be-ebccd9e693a4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:57.428080 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a84d007b-b287-4998-b4be-ebccd9e693a4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:57.428348 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a84d007b-b287-4998-b4be-ebccd9e693a4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:57.441908 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4bd98f7b-c08b-4d91-b2f5-df4c3ae3d296 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:57.444706 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4bd98f7b-c08b-4d91-b2f5-df4c3ae3d296 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:57.466720 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4bd98f7b-c08b-4d91-b2f5-df4c3ae3d296 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:57.467505 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4bd98f7b-c08b-4d91-b2f5-df4c3ae3d296 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:57.468106 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4bd98f7b-c08b-4d91-b2f5-df4c3ae3d296 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:57.470439 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4bd98f7b-c08b-4d91-b2f5-df4c3ae3d296 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:57.471061 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4bd98f7b-c08b-4d91-b2f5-df4c3ae3d296 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:57.471658 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4bd98f7b-c08b-4d91-b2f5-df4c3ae3d296 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:57.702947 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a84d007b-b287-4998-b4be-ebccd9e693a4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:57.712468 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a84d007b-b287-4998-b4be-ebccd9e693a4 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1517 microversion: 2.1 time: 0.297397 Sep 23 14:08:57.714644 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 367/729] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:57 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1517 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:08:57.739283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4bd98f7b-c08b-4d91-b2f5-df4c3ae3d296 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:57.749332 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4bd98f7b-c08b-4d91-b2f5-df4c3ae3d296 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:57.751324 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4bd98f7b-c08b-4d91-b2f5-df4c3ae3d296 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:57.764925 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4bd98f7b-c08b-4d91-b2f5-df4c3ae3d296 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1739 microversion: 2.20 time: 0.318115 Sep 23 14:08:57.764925 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 363/730] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:57 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1739 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:08:58.420131 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fe606f6a-6cb0-469e-82df-40f8d9d34739 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:58.422266 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-fe606f6a-6cb0-469e-82df-40f8d9d34739 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:58.432362 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fe606f6a-6cb0-469e-82df-40f8d9d34739 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:58.432968 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fe606f6a-6cb0-469e-82df-40f8d9d34739 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:58.433493 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fe606f6a-6cb0-469e-82df-40f8d9d34739 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:58.434990 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fe606f6a-6cb0-469e-82df-40f8d9d34739 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:58.435715 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fe606f6a-6cb0-469e-82df-40f8d9d34739 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:58.436444 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fe606f6a-6cb0-469e-82df-40f8d9d34739 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:58.468225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fe606f6a-6cb0-469e-82df-40f8d9d34739 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051937 Sep 23 14:08:58.473024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 368/731] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:08:58 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:08:58.744930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-aac0fc7e-ab27-4de1-a3eb-016520df2ab6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:58.745551 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-aac0fc7e-ab27-4de1-a3eb-016520df2ab6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:58.755915 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aac0fc7e-ab27-4de1-a3eb-016520df2ab6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:58.756473 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aac0fc7e-ab27-4de1-a3eb-016520df2ab6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:58.756905 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aac0fc7e-ab27-4de1-a3eb-016520df2ab6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:58.757606 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aac0fc7e-ab27-4de1-a3eb-016520df2ab6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:58.758070 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aac0fc7e-ab27-4de1-a3eb-016520df2ab6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:58.758527 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aac0fc7e-ab27-4de1-a3eb-016520df2ab6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:58.790633 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-bbdf6ff3-ef7a-458a-af9d-3a2043dd88c0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:58.791286 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-bbdf6ff3-ef7a-458a-af9d-3a2043dd88c0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:58.797875 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bbdf6ff3-ef7a-458a-af9d-3a2043dd88c0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:58.798402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bbdf6ff3-ef7a-458a-af9d-3a2043dd88c0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:58.798866 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bbdf6ff3-ef7a-458a-af9d-3a2043dd88c0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:58.799559 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bbdf6ff3-ef7a-458a-af9d-3a2043dd88c0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:58.800107 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bbdf6ff3-ef7a-458a-af9d-3a2043dd88c0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:58.800532 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bbdf6ff3-ef7a-458a-af9d-3a2043dd88c0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:58.977109 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-aac0fc7e-ab27-4de1-a3eb-016520df2ab6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:58.985638 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-bbdf6ff3-ef7a-458a-af9d-3a2043dd88c0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:58.986018 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-aac0fc7e-ab27-4de1-a3eb-016520df2ab6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1519 microversion: 2.1 time: 0.245331 Sep 23 14:08:58.986627 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 364/732] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:08:58 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1519 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:08:58.993760 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-bbdf6ff3-ef7a-458a-af9d-3a2043dd88c0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:58.995317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-bbdf6ff3-ef7a-458a-af9d-3a2043dd88c0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:08:58.996971 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-bbdf6ff3-ef7a-458a-af9d-3a2043dd88c0 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1739 microversion: 2.20 time: 0.210232 Sep 23 14:08:58.997520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 369/733] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:08:58 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:08:59.481161 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-92a09e34-9fbb-4298-bdf6-f7f50a07deff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:59.483428 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-92a09e34-9fbb-4298-bdf6-f7f50a07deff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:59.488491 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:59.493117 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-92a09e34-9fbb-4298-bdf6-f7f50a07deff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:59.493694 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-92a09e34-9fbb-4298-bdf6-f7f50a07deff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:59.494407 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-92a09e34-9fbb-4298-bdf6-f7f50a07deff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:59.498549 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-92a09e34-9fbb-4298-bdf6-f7f50a07deff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:59.498549 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-92a09e34-9fbb-4298-bdf6-f7f50a07deff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:59.498549 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-92a09e34-9fbb-4298-bdf6-f7f50a07deff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:59.526461 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-92a09e34-9fbb-4298-bdf6-f7f50a07deff tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049159 Sep 23 14:08:59.527038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 365/734] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:08:59 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 14:08:59.599792 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-49387073-fcc3-4c79-ac14-a506edfebd44 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:08:59.599792 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-49387073-fcc3-4c79-ac14-a506edfebd44 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:08:59.603073 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49387073-fcc3-4c79-ac14-a506edfebd44 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:59.603558 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49387073-fcc3-4c79-ac14-a506edfebd44 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:59.604006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49387073-fcc3-4c79-ac14-a506edfebd44 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:59.604734 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49387073-fcc3-4c79-ac14-a506edfebd44 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:08:59.605225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49387073-fcc3-4c79-ac14-a506edfebd44 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:08:59.605731 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49387073-fcc3-4c79-ac14-a506edfebd44 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:08:59.632797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-49387073-fcc3-4c79-ac14-a506edfebd44 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Going to try to terminate instance {{(pid=121074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:09:00.010807 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d208fe38-7098-4cb9-96d7-275efa7f50bd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:00.012043 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d208fe38-7098-4cb9-96d7-275efa7f50bd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:00.022503 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-49387073-fcc3-4c79-ac14-a506edfebd44 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 204 len: 0 microversion: 2.1 time: 0.431333 Sep 23 14:09:00.023148 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 370/735] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:08:59 2022] DELETE /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 14:09:00.030131 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d208fe38-7098-4cb9-96d7-275efa7f50bd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:00.030667 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d208fe38-7098-4cb9-96d7-275efa7f50bd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:00.030797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ef98ea5f-81e9-49f8-8511-92bd3389b059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:00.031284 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d208fe38-7098-4cb9-96d7-275efa7f50bd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:00.031472 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ef98ea5f-81e9-49f8-8511-92bd3389b059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:00.032000 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d208fe38-7098-4cb9-96d7-275efa7f50bd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:00.032630 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d208fe38-7098-4cb9-96d7-275efa7f50bd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:00.033218 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d208fe38-7098-4cb9-96d7-275efa7f50bd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:00.038423 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ef98ea5f-81e9-49f8-8511-92bd3389b059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:00.039111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ef98ea5f-81e9-49f8-8511-92bd3389b059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:00.039553 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ef98ea5f-81e9-49f8-8511-92bd3389b059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:00.040287 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ef98ea5f-81e9-49f8-8511-92bd3389b059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:00.040777 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ef98ea5f-81e9-49f8-8511-92bd3389b059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:00.041208 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ef98ea5f-81e9-49f8-8511-92bd3389b059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:00.255763 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d208fe38-7098-4cb9-96d7-275efa7f50bd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:00.265173 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d208fe38-7098-4cb9-96d7-275efa7f50bd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1519 microversion: 2.1 time: 0.258426 Sep 23 14:09:00.265764 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 366/736] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:00 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1519 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:09:00.270626 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ca514da8-13eb-4ae8-8b63-9f1e0b04a43a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:00.271237 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ca514da8-13eb-4ae8-8b63-9f1e0b04a43a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:00.274654 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ef98ea5f-81e9-49f8-8511-92bd3389b059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:00.277011 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca514da8-13eb-4ae8-8b63-9f1e0b04a43a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:00.277492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca514da8-13eb-4ae8-8b63-9f1e0b04a43a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:00.277937 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca514da8-13eb-4ae8-8b63-9f1e0b04a43a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:00.279190 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca514da8-13eb-4ae8-8b63-9f1e0b04a43a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:00.279642 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca514da8-13eb-4ae8-8b63-9f1e0b04a43a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:00.280242 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ca514da8-13eb-4ae8-8b63-9f1e0b04a43a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:00.285240 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ef98ea5f-81e9-49f8-8511-92bd3389b059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:00.287033 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ef98ea5f-81e9-49f8-8511-92bd3389b059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:00.291964 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ef98ea5f-81e9-49f8-8511-92bd3389b059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1721 microversion: 2.20 time: 0.263573 Sep 23 14:09:00.291964 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 371/737] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:00 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:00.414253 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ca514da8-13eb-4ae8-8b63-9f1e0b04a43a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:00.423141 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ca514da8-13eb-4ae8-8b63-9f1e0b04a43a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1681 microversion: 2.1 time: 0.156213 Sep 23 14:09:00.423713 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 367/738] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:00 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:01.288739 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e7707557-ca39-4277-9120-34ba08b8a612 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:01.289561 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e7707557-ca39-4277-9120-34ba08b8a612 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:01.296355 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e7707557-ca39-4277-9120-34ba08b8a612 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:01.296837 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e7707557-ca39-4277-9120-34ba08b8a612 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:01.297267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e7707557-ca39-4277-9120-34ba08b8a612 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:01.297981 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e7707557-ca39-4277-9120-34ba08b8a612 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:01.298464 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e7707557-ca39-4277-9120-34ba08b8a612 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:01.298887 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e7707557-ca39-4277-9120-34ba08b8a612 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:01.316525 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b0c1f88a-846b-4706-8c39-6a8ba533ea83 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:01.317141 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b0c1f88a-846b-4706-8c39-6a8ba533ea83 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:01.326180 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b0c1f88a-846b-4706-8c39-6a8ba533ea83 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:01.326697 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b0c1f88a-846b-4706-8c39-6a8ba533ea83 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:01.327201 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b0c1f88a-846b-4706-8c39-6a8ba533ea83 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:01.327960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b0c1f88a-846b-4706-8c39-6a8ba533ea83 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:01.328428 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b0c1f88a-846b-4706-8c39-6a8ba533ea83 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:01.328929 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b0c1f88a-846b-4706-8c39-6a8ba533ea83 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:01.496147 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e7707557-ca39-4277-9120-34ba08b8a612 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:01.505975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b0c1f88a-846b-4706-8c39-6a8ba533ea83 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:01.510715 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e7707557-ca39-4277-9120-34ba08b8a612 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1519 microversion: 2.1 time: 0.225522 Sep 23 14:09:01.511295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 372/739] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:01 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:01.516783 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-cf3ec66e-0cc1-471e-abf3-296e730d2ad2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:01.517390 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-cf3ec66e-0cc1-471e-abf3-296e730d2ad2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:01.523177 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b0c1f88a-846b-4706-8c39-6a8ba533ea83 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:01.523468 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cf3ec66e-0cc1-471e-abf3-296e730d2ad2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:01.524132 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cf3ec66e-0cc1-471e-abf3-296e730d2ad2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:01.524574 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cf3ec66e-0cc1-471e-abf3-296e730d2ad2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:01.525271 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cf3ec66e-0cc1-471e-abf3-296e730d2ad2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:01.525727 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cf3ec66e-0cc1-471e-abf3-296e730d2ad2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:01.526157 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cf3ec66e-0cc1-471e-abf3-296e730d2ad2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:01.526424 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b0c1f88a-846b-4706-8c39-6a8ba533ea83 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:01.527724 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b0c1f88a-846b-4706-8c39-6a8ba533ea83 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1721 microversion: 2.20 time: 0.215198 Sep 23 14:09:01.529105 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 368/740] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:01 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:09:01.546053 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:01.694556 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-cf3ec66e-0cc1-471e-abf3-296e730d2ad2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:01.701944 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-cf3ec66e-0cc1-471e-abf3-296e730d2ad2 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1681 microversion: 2.1 time: 0.189441 Sep 23 14:09:01.702569 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 373/741] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:01 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:02.534511 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-64c5bb40-1cd3-4d8e-8876-c188e759c7d8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:02.535124 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-64c5bb40-1cd3-4d8e-8876-c188e759c7d8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:02.541520 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-64c5bb40-1cd3-4d8e-8876-c188e759c7d8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:02.542003 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-64c5bb40-1cd3-4d8e-8876-c188e759c7d8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:02.542475 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-64c5bb40-1cd3-4d8e-8876-c188e759c7d8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:02.544653 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-64c5bb40-1cd3-4d8e-8876-c188e759c7d8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:02.544653 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-64c5bb40-1cd3-4d8e-8876-c188e759c7d8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:02.544653 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-64c5bb40-1cd3-4d8e-8876-c188e759c7d8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:02.555878 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f2f37fb5-cee3-4b35-9779-3361ea4057af tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:02.556492 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f2f37fb5-cee3-4b35-9779-3361ea4057af tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:02.559786 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:02.564495 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f2f37fb5-cee3-4b35-9779-3361ea4057af tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:02.564986 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f2f37fb5-cee3-4b35-9779-3361ea4057af tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:02.565429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f2f37fb5-cee3-4b35-9779-3361ea4057af tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:02.566136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f2f37fb5-cee3-4b35-9779-3361ea4057af tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:02.566625 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f2f37fb5-cee3-4b35-9779-3361ea4057af tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:02.567058 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f2f37fb5-cee3-4b35-9779-3361ea4057af tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:03.051643 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-64c5bb40-1cd3-4d8e-8876-c188e759c7d8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:03.059867 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-64c5bb40-1cd3-4d8e-8876-c188e759c7d8 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.529147 Sep 23 14:09:03.060440 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 369/742] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:02 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:03.065051 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-aa76d94f-3763-4c09-9362-3162f637c3cb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:03.065852 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-aa76d94f-3763-4c09-9362-3162f637c3cb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:03.071557 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aa76d94f-3763-4c09-9362-3162f637c3cb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:03.076859 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aa76d94f-3763-4c09-9362-3162f637c3cb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:03.076859 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aa76d94f-3763-4c09-9362-3162f637c3cb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:03.076859 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aa76d94f-3763-4c09-9362-3162f637c3cb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:03.076859 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aa76d94f-3763-4c09-9362-3162f637c3cb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:03.077415 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aa76d94f-3763-4c09-9362-3162f637c3cb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:03.089532 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f2f37fb5-cee3-4b35-9779-3361ea4057af tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:03.098554 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f2f37fb5-cee3-4b35-9779-3361ea4057af tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:03.100070 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f2f37fb5-cee3-4b35-9779-3361ea4057af tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:03.101227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f2f37fb5-cee3-4b35-9779-3361ea4057af tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1721 microversion: 2.20 time: 0.549237 Sep 23 14:09:03.101782 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 374/743] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:02 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1721 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:09:03.278617 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-aa76d94f-3763-4c09-9362-3162f637c3cb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:03.286799 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-aa76d94f-3763-4c09-9362-3162f637c3cb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1681 microversion: 2.1 time: 0.225281 Sep 23 14:09:03.287485 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 370/744] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:03 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:03.391886 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-2c499ffb-8960-4291-a199-4ca5f41f00a7 req-490cd726-37c1-4439-8dc3-bb25a0c92392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49eff20-f8a6-404b-b09c-def6e4c167ca", "name": "network-vif-unplugged", "status": "completed", "tag": "20043706-94ae-416a-96d1-e1f2fc14183b"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:09:03.401917 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-2c499ffb-8960-4291-a199-4ca5f41f00a7 req-490cd726-37c1-4439-8dc3-bb25a0c92392 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:03.402808 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-2c499ffb-8960-4291-a199-4ca5f41f00a7 req-490cd726-37c1-4439-8dc3-bb25a0c92392 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:03.404149 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-2c499ffb-8960-4291-a199-4ca5f41f00a7 req-490cd726-37c1-4439-8dc3-bb25a0c92392 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:03.415466 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-2c499ffb-8960-4291-a199-4ca5f41f00a7 req-490cd726-37c1-4439-8dc3-bb25a0c92392 service nova] Creating event network-vif-unplugged:20043706-94ae-416a-96d1-e1f2fc14183b for instance c49eff20-f8a6-404b-b09c-def6e4c167ca on hv-cinder-85743 Sep 23 14:09:03.420683 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-2c499ffb-8960-4291-a199-4ca5f41f00a7 req-490cd726-37c1-4439-8dc3-bb25a0c92392 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033491 Sep 23 14:09:03.421473 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 375/745] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:09:04.084066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3f8f6a4e-d84c-4951-a10d-f872390e1d82 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:04.084677 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3f8f6a4e-d84c-4951-a10d-f872390e1d82 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:04.091710 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f8f6a4e-d84c-4951-a10d-f872390e1d82 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:04.092546 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f8f6a4e-d84c-4951-a10d-f872390e1d82 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:04.093229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f8f6a4e-d84c-4951-a10d-f872390e1d82 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:04.094252 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f8f6a4e-d84c-4951-a10d-f872390e1d82 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:04.095171 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f8f6a4e-d84c-4951-a10d-f872390e1d82 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:04.096066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3f8f6a4e-d84c-4951-a10d-f872390e1d82 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:04.128403 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-49f45e6f-804a-49cb-998b-396170d249a2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:04.129023 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-49f45e6f-804a-49cb-998b-396170d249a2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:04.137753 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49f45e6f-804a-49cb-998b-396170d249a2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:04.140620 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49f45e6f-804a-49cb-998b-396170d249a2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:04.141246 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49f45e6f-804a-49cb-998b-396170d249a2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:04.142267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49f45e6f-804a-49cb-998b-396170d249a2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:04.144985 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49f45e6f-804a-49cb-998b-396170d249a2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:04.145625 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-49f45e6f-804a-49cb-998b-396170d249a2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:04.308111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3f8f6a4e-d84c-4951-a10d-f872390e1d82 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:04.319429 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3f8f6a4e-d84c-4951-a10d-f872390e1d82 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.238559 Sep 23 14:09:04.334492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 371/746] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:04 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:04.334492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-60707e7b-3cf0-4e09-8a51-2eb564c096a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:04.334492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-60707e7b-3cf0-4e09-8a51-2eb564c096a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:04.334492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-60707e7b-3cf0-4e09-8a51-2eb564c096a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:04.334851 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-60707e7b-3cf0-4e09-8a51-2eb564c096a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:04.334851 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-60707e7b-3cf0-4e09-8a51-2eb564c096a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:04.335024 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-60707e7b-3cf0-4e09-8a51-2eb564c096a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:04.335551 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-60707e7b-3cf0-4e09-8a51-2eb564c096a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:04.336049 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-60707e7b-3cf0-4e09-8a51-2eb564c096a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:04.343692 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:04.398990 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-49f45e6f-804a-49cb-998b-396170d249a2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:04.411815 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-49f45e6f-804a-49cb-998b-396170d249a2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:04.413595 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-49f45e6f-804a-49cb-998b-396170d249a2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:04.416373 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-49f45e6f-804a-49cb-998b-396170d249a2 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1721 microversion: 2.20 time: 0.291060 Sep 23 14:09:04.417606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 376/747] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:04 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:04.551155 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-60707e7b-3cf0-4e09-8a51-2eb564c096a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:04.561508 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-60707e7b-3cf0-4e09-8a51-2eb564c096a1 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1681 microversion: 2.1 time: 0.240286 Sep 23 14:09:04.562324 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 372/748] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:04 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:04.759946 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-62ea21c4-5713-4591-bba7-692d9ba8fa07 req-5a0b6feb-127e-4fbd-bca6-4ebb4e84449e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eabc1ecf-db30-497e-ab52-807dbb0f9a09", "name": "network-vif-deleted", "tag": "9f434098-b75f-420c-929f-b2ab8d58d384"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:09:04.764752 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-62ea21c4-5713-4591-bba7-692d9ba8fa07 req-5a0b6feb-127e-4fbd-bca6-4ebb4e84449e service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:04.765480 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-62ea21c4-5713-4591-bba7-692d9ba8fa07 req-5a0b6feb-127e-4fbd-bca6-4ebb4e84449e service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:04.766029 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-62ea21c4-5713-4591-bba7-692d9ba8fa07 req-5a0b6feb-127e-4fbd-bca6-4ebb4e84449e service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:04.783724 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-62ea21c4-5713-4591-bba7-692d9ba8fa07 req-5a0b6feb-127e-4fbd-bca6-4ebb4e84449e service nova] Creating event network-vif-deleted:9f434098-b75f-420c-929f-b2ab8d58d384 for instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 on hv-cinder-85743 Sep 23 14:09:04.788996 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-62ea21c4-5713-4591-bba7-692d9ba8fa07 req-5a0b6feb-127e-4fbd-bca6-4ebb4e84449e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037474 Sep 23 14:09:04.789604 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 377/749] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:09:05.346321 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8acc4140-25a2-4ecf-8553-cc1622048293 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:05.346991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-8acc4140-25a2-4ecf-8553-cc1622048293 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:05.358302 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8acc4140-25a2-4ecf-8553-cc1622048293 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:05.359168 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8acc4140-25a2-4ecf-8553-cc1622048293 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:05.360190 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8acc4140-25a2-4ecf-8553-cc1622048293 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:05.361270 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8acc4140-25a2-4ecf-8553-cc1622048293 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:05.361942 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8acc4140-25a2-4ecf-8553-cc1622048293 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:05.363320 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8acc4140-25a2-4ecf-8553-cc1622048293 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:05.444090 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4fdd618e-87b2-4f34-8544-c2969927405e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:05.445493 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4fdd618e-87b2-4f34-8544-c2969927405e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:05.452940 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4fdd618e-87b2-4f34-8544-c2969927405e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:05.453671 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4fdd618e-87b2-4f34-8544-c2969927405e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:05.454177 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4fdd618e-87b2-4f34-8544-c2969927405e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:05.454973 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4fdd618e-87b2-4f34-8544-c2969927405e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:05.455502 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4fdd618e-87b2-4f34-8544-c2969927405e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:05.455996 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4fdd618e-87b2-4f34-8544-c2969927405e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:05.562431 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-8acc4140-25a2-4ecf-8553-cc1622048293 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:05.589150 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8acc4140-25a2-4ecf-8553-cc1622048293 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.247285 Sep 23 14:09:05.591590 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 373/750] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:05 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:09:05.597482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d9a8812a-7fbe-43dc-9196-2f833d50ebfb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:05.598280 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d9a8812a-7fbe-43dc-9196-2f833d50ebfb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:05.606797 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9a8812a-7fbe-43dc-9196-2f833d50ebfb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:05.607865 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9a8812a-7fbe-43dc-9196-2f833d50ebfb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:05.608372 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9a8812a-7fbe-43dc-9196-2f833d50ebfb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:05.609314 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9a8812a-7fbe-43dc-9196-2f833d50ebfb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:05.610034 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9a8812a-7fbe-43dc-9196-2f833d50ebfb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:05.610598 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9a8812a-7fbe-43dc-9196-2f833d50ebfb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:05.649508 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9a8812a-7fbe-43dc-9196-2f833d50ebfb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:05.650803 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9a8812a-7fbe-43dc-9196-2f833d50ebfb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:05.651514 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9a8812a-7fbe-43dc-9196-2f833d50ebfb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:05.652628 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-d9a8812a-7fbe-43dc-9196-2f833d50ebfb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lazy-loading 'fault' on Instance uuid eabc1ecf-db30-497e-ab52-807dbb0f9a09 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:09:05.655133 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4fdd618e-87b2-4f34-8544-c2969927405e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:05.668710 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4fdd618e-87b2-4f34-8544-c2969927405e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:05.670290 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4fdd618e-87b2-4f34-8544-c2969927405e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:05.672234 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4fdd618e-87b2-4f34-8544-c2969927405e tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1664 microversion: 2.20 time: 0.232887 Sep 23 14:09:05.673563 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 378/751] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:05 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1664 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:09:05.698966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-93ccb883-46ee-4be2-b39e-2592975f9faf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01226735-ff69-473d-b9c9-18e9674fe490"}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:09:05.708756 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-93ccb883-46ee-4be2-b39e-2592975f9faf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:05.711755 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d9a8812a-7fbe-43dc-9196-2f833d50ebfb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db30f990aae49fabf9b8b19cd019de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482490c45ac64607bba9ad021f2effbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:05.716621 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-93ccb883-46ee-4be2-b39e-2592975f9faf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:05.716838 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-93ccb883-46ee-4be2-b39e-2592975f9faf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:05.717430 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-93ccb883-46ee-4be2-b39e-2592975f9faf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:05.718209 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-93ccb883-46ee-4be2-b39e-2592975f9faf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:05.718700 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-93ccb883-46ee-4be2-b39e-2592975f9faf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:05.721149 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-93ccb883-46ee-4be2-b39e-2592975f9faf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:05.721437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d9a8812a-7fbe-43dc-9196-2f833d50ebfb tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 200 len: 1331 microversion: 2.1 time: 0.127941 Sep 23 14:09:05.722198 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 374/752] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:05 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 1331 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:06.615017 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d0bc221b-69d4-4eb7-b444-fbb4e377b40c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:06.615665 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d0bc221b-69d4-4eb7-b444-fbb4e377b40c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:06.625165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d0bc221b-69d4-4eb7-b444-fbb4e377b40c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:06.625662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d0bc221b-69d4-4eb7-b444-fbb4e377b40c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:06.626094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d0bc221b-69d4-4eb7-b444-fbb4e377b40c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:06.626822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d0bc221b-69d4-4eb7-b444-fbb4e377b40c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:06.627283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d0bc221b-69d4-4eb7-b444-fbb4e377b40c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:06.627704 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d0bc221b-69d4-4eb7-b444-fbb4e377b40c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:06.767240 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d0bc221b-69d4-4eb7-b444-fbb4e377b40c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:06.776301 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d0bc221b-69d4-4eb7-b444-fbb4e377b40c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.165527 Sep 23 14:09:06.776869 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 375/753] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:06 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:09:06.782583 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4793ffd0-4697-4a9e-b24b-c7f4ed37966a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:06.783574 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4793ffd0-4697-4a9e-b24b-c7f4ed37966a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:06.789568 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4793ffd0-4697-4a9e-b24b-c7f4ed37966a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:06.790229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4793ffd0-4697-4a9e-b24b-c7f4ed37966a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:06.790945 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4793ffd0-4697-4a9e-b24b-c7f4ed37966a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:06.791846 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4793ffd0-4697-4a9e-b24b-c7f4ed37966a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:06.792486 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4793ffd0-4697-4a9e-b24b-c7f4ed37966a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:06.793108 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4793ffd0-4697-4a9e-b24b-c7f4ed37966a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:06.808049 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-4793ffd0-4697-4a9e-b24b-c7f4ed37966a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] HTTP exception thrown: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4793ffd0-4697-4a9e-b24b-c7f4ed37966a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Request method failure captured: Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 HTTP/1.1 Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbxrzANyu0HiE-RI6YrwV4d8fV10ylWEIATegCXV8WUB95m5oAKUEypeFaRSmFIPzbJ8OQMl6Aud1_-7wjU4ZO6GDRxJPylRi9sW9fsJGE2eeMrNRP5hVeqDi3IdZCENn82q0KEmt_9wVferpVh22qvGQNXZFPNp1vMViuNoGirJUN4 Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:09:06.810512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:09:06.812094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_482490c45ac64607bba9ad021f2effbf"}]}] Sep 23 14:09:06.812094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:06.812094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:06.812094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:06.812094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:06.812094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:09:06.812094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:09:06.812094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 0db30f990aae49fabf9b8b19cd019de9 Sep 23 14:09:06.812094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:06.812094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:09:06.812094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:06.812094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': 'eabc1ecf-db30-497e-ab52-807dbb0f9a09'} Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:09:06.813023 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:06.814448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:06.815638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4793ffd0-4697-4a9e-b24b-c7f4ed37966a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Returning 404 to user: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:09:06.815638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4793ffd0-4697-4a9e-b24b-c7f4ed37966a tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 404 len: 111 microversion: 2.1 time: 0.034169 Sep 23 14:09:06.815638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 376/754] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:06 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:09:06.826607 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-fe9d7e26-2240-4374-9680-236be1bad322 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '.version_select at 0x7f9083a72430>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:06.901573 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-93ccb883-46ee-4be2-b39e-2592975f9faf tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "POST /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.206941 Sep 23 14:09:06.902217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 379/755] 10.222.0.62 () {62 vars in 1364 bytes} [Fri Sep 23 14:09:05 2022] POST /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca/os-volume_attachments => generated 188 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 14:09:06.925813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-fe9d7e26-2240-4374-9680-236be1bad322 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1343929215" status: 202 len: 0 microversion: 2.1 time: 0.103601 Sep 23 14:09:06.926425 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 377/756] 10.222.0.62 () {58 vars in 1221 bytes} [Fri Sep 23 14:09:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1343929215 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:09:07.039763 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-65c2067a-c5bd-4661-b821-e8ff80972eb9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:07.039763 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-65c2067a-c5bd-4661-b821-e8ff80972eb9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:07.045600 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-65c2067a-c5bd-4661-b821-e8ff80972eb9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:07.046098 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-65c2067a-c5bd-4661-b821-e8ff80972eb9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:07.046611 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-65c2067a-c5bd-4661-b821-e8ff80972eb9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:07.047309 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-65c2067a-c5bd-4661-b821-e8ff80972eb9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:07.047834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-65c2067a-c5bd-4661-b821-e8ff80972eb9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:07.048286 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-65c2067a-c5bd-4661-b821-e8ff80972eb9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:07.689968 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-65c2067a-c5bd-4661-b821-e8ff80972eb9 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca/os-volume_attachments/01226735-ff69-473d-b9c9-18e9674fe490" status: 202 len: 0 microversion: 2.20 time: 0.656562 Sep 23 14:09:07.690928 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 380/757] 10.222.0.62 () {60 vars in 1457 bytes} [Fri Sep 23 14:09:07 2022] DELETE /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca/os-volume_attachments/01226735-ff69-473d-b9c9-18e9674fe490 => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:09:07.768910 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f624dcf4-7f03-4a2c-b379-6bf2a163d40b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:09:07.769620 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f624dcf4-7f03-4a2c-b379-6bf2a163d40b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:07.776723 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f624dcf4-7f03-4a2c-b379-6bf2a163d40b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:07.777208 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f624dcf4-7f03-4a2c-b379-6bf2a163d40b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:07.777638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f624dcf4-7f03-4a2c-b379-6bf2a163d40b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:07.778435 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f624dcf4-7f03-4a2c-b379-6bf2a163d40b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:07.778894 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f624dcf4-7f03-4a2c-b379-6bf2a163d40b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:07.779339 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f624dcf4-7f03-4a2c-b379-6bf2a163d40b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:07.800509 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-3606b509-6041-480c-ba39-4cad9cfcb3b9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:07.801125 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-3606b509-6041-480c-ba39-4cad9cfcb3b9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:07.807735 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3606b509-6041-480c-ba39-4cad9cfcb3b9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:07.808268 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3606b509-6041-480c-ba39-4cad9cfcb3b9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:07.808704 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3606b509-6041-480c-ba39-4cad9cfcb3b9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:07.809729 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f624dcf4-7f03-4a2c-b379-6bf2a163d40b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121073) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 14:09:07.809941 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3606b509-6041-480c-ba39-4cad9cfcb3b9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:07.810639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3606b509-6041-480c-ba39-4cad9cfcb3b9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:07.811071 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3606b509-6041-480c-ba39-4cad9cfcb3b9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:07.938955 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-3606b509-6041-480c-ba39-4cad9cfcb3b9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:07.946682 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-3606b509-6041-480c-ba39-4cad9cfcb3b9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.149991 Sep 23 14:09:07.947249 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 381/758] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:07 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:09:08.166429 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f624dcf4-7f03-4a2c-b379-6bf2a163d40b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "POST /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca/action" status: 202 len: 0 microversion: 2.20 time: 0.401887 Sep 23 14:09:08.166961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 378/759] 10.222.0.62 () {62 vars in 1319 bytes} [Fri Sep 23 14:09:07 2022] POST /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:09:08.175119 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-95bec41d-550e-48c5-95e9-2a2fc6183553 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:08.175707 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-95bec41d-550e-48c5-95e9-2a2fc6183553 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:08.181891 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-95bec41d-550e-48c5-95e9-2a2fc6183553 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:08.182409 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-95bec41d-550e-48c5-95e9-2a2fc6183553 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:08.182849 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-95bec41d-550e-48c5-95e9-2a2fc6183553 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:08.183535 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-95bec41d-550e-48c5-95e9-2a2fc6183553 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:08.184761 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-95bec41d-550e-48c5-95e9-2a2fc6183553 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:08.185225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-95bec41d-550e-48c5-95e9-2a2fc6183553 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:08.321078 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-95bec41d-550e-48c5-95e9-2a2fc6183553 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:08.329941 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-95bec41d-550e-48c5-95e9-2a2fc6183553 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:08.335968 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-95bec41d-550e-48c5-95e9-2a2fc6183553 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:08.335968 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-95bec41d-550e-48c5-95e9-2a2fc6183553 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1672 microversion: 2.20 time: 0.161257 Sep 23 14:09:08.335968 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 382/760] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:08 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:08.971468 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4857a835-c849-4daf-ab20-d675e656784b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:08.972234 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4857a835-c849-4daf-ab20-d675e656784b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:08.979827 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4857a835-c849-4daf-ab20-d675e656784b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:08.980588 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4857a835-c849-4daf-ab20-d675e656784b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:08.981304 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4857a835-c849-4daf-ab20-d675e656784b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:08.982180 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4857a835-c849-4daf-ab20-d675e656784b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:08.982787 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4857a835-c849-4daf-ab20-d675e656784b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:08.983320 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4857a835-c849-4daf-ab20-d675e656784b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:09.077731 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-94890526-db66-40b3-b288-139b023da4d6 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:09.078319 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-94890526-db66-40b3-b288-139b023da4d6 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:09.084321 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94890526-db66-40b3-b288-139b023da4d6 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:09.084810 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94890526-db66-40b3-b288-139b023da4d6 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:09.085243 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94890526-db66-40b3-b288-139b023da4d6 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:09.085935 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94890526-db66-40b3-b288-139b023da4d6 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:09.086603 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94890526-db66-40b3-b288-139b023da4d6 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:09.087029 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-94890526-db66-40b3-b288-139b023da4d6 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:09.103329 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-94890526-db66-40b3-b288-139b023da4d6 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] HTTP exception thrown: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-94890526-db66-40b3-b288-139b023da4d6 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Request method failure captured: Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: DELETE /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 HTTP/1.1 Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxrzANyu0HiE-RI6YrwV4d8fV10ylWEIATegCXV8WUB95m5oAKUEypeFaRSmFIPzbJ8OQMl6Aud1_-7wjU4ZO6GDRxJPylRi9sW9fsJGE2eeMrNRP5hVeqDi3IdZCENn82q0KEmt_9wVferpVh22qvGQNXZFPNp1vMViuNoGirJUN4 Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:09:09.105043 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:09:09.107154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_482490c45ac64607bba9ad021f2effbf"}]}] Sep 23 14:09:09.107154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:09.107154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:09.107154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:09.107154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:09.107154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:09:09.107154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:09:09.107154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 0db30f990aae49fabf9b8b19cd019de9 Sep 23 14:09:09.107154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:09.107154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:09:09.107154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:09.107154 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': 'eabc1ecf-db30-497e-ab52-807dbb0f9a09'} Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:09:09.108026 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:09.109295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:09.112547 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-94890526-db66-40b3-b288-139b023da4d6 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Returning 404 to user: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:09:09.112547 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-94890526-db66-40b3-b288-139b023da4d6 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 404 len: 111 microversion: 2.1 time: 0.036553 Sep 23 14:09:09.112547 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 383/761] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:09:09 2022] DELETE /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:09:09.117297 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ba0c7a8b-9821-48cd-a7fc-4cbd2e81f81b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:09.118041 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ba0c7a8b-9821-48cd-a7fc-4cbd2e81f81b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eabc1ecf-db30-497e-ab52-807dbb0f9a09] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:09.126488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ba0c7a8b-9821-48cd-a7fc-4cbd2e81f81b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:09.127132 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ba0c7a8b-9821-48cd-a7fc-4cbd2e81f81b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:09.127675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ba0c7a8b-9821-48cd-a7fc-4cbd2e81f81b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:09.128874 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ba0c7a8b-9821-48cd-a7fc-4cbd2e81f81b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:09.129655 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ba0c7a8b-9821-48cd-a7fc-4cbd2e81f81b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:09.130497 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ba0c7a8b-9821-48cd-a7fc-4cbd2e81f81b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:09.147988 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-ba0c7a8b-9821-48cd-a7fc-4cbd2e81f81b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] HTTP exception thrown: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ba0c7a8b-9821-48cd-a7fc-4cbd2e81f81b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Request method failure captured: Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 HTTP/1.1 Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxrzANyu0HiE-RI6YrwV4d8fV10ylWEIATegCXV8WUB95m5oAKUEypeFaRSmFIPzbJ8OQMl6Aud1_-7wjU4ZO6GDRxJPylRi9sW9fsJGE2eeMrNRP5hVeqDi3IdZCENn82q0KEmt_9wVferpVh22qvGQNXZFPNp1vMViuNoGirJUN4 Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:09:09.150443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:09:09.154006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_482490c45ac64607bba9ad021f2effbf"}]}] Sep 23 14:09:09.154006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:09.154006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:09.154006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:09.154006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:09.154006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:09:09.154006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:09:09.154006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 0db30f990aae49fabf9b8b19cd019de9 Sep 23 14:09:09.154006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:09.154006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:09:09.154006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:09.154006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': 'eabc1ecf-db30-497e-ab52-807dbb0f9a09'} Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:09:09.155136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. Sep 23 14:09:09.156797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:09.158094 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ba0c7a8b-9821-48cd-a7fc-4cbd2e81f81b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Returning 404 to user: Instance eabc1ecf-db30-497e-ab52-807dbb0f9a09 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:09:09.158094 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ba0c7a8b-9821-48cd-a7fc-4cbd2e81f81b tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09" status: 404 len: 111 microversion: 2.1 time: 0.039197 Sep 23 14:09:09.158094 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 384/762] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:09 2022] GET /compute/v2.1/servers/eabc1ecf-db30-497e-ab52-807dbb0f9a09 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 14:09:09.179619 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4857a835-c849-4daf-ab20-d675e656784b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:09.189899 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4857a835-c849-4daf-ab20-d675e656784b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.223307 Sep 23 14:09:09.191205 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 379/763] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:08 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:09.360759 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e9c6febc-21af-4c8f-a6a3-754e6cc92f5a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:09.361390 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e9c6febc-21af-4c8f-a6a3-754e6cc92f5a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:09.367808 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e9c6febc-21af-4c8f-a6a3-754e6cc92f5a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:09.368302 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e9c6febc-21af-4c8f-a6a3-754e6cc92f5a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:09.368741 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e9c6febc-21af-4c8f-a6a3-754e6cc92f5a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:09.372993 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e9c6febc-21af-4c8f-a6a3-754e6cc92f5a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:09.373158 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e9c6febc-21af-4c8f-a6a3-754e6cc92f5a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:09.374220 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e9c6febc-21af-4c8f-a6a3-754e6cc92f5a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:09.521902 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e9c6febc-21af-4c8f-a6a3-754e6cc92f5a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:09.532778 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e9c6febc-21af-4c8f-a6a3-754e6cc92f5a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:09.535145 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e9c6febc-21af-4c8f-a6a3-754e6cc92f5a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:09.536303 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e9c6febc-21af-4c8f-a6a3-754e6cc92f5a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1672 microversion: 2.20 time: 0.180081 Sep 23 14:09:09.536854 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 385/764] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:09 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1672 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:10.218791 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c6249178-18a7-4cea-ab59-766406f29f3a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:10.219523 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c6249178-18a7-4cea-ab59-766406f29f3a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:10.226014 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6249178-18a7-4cea-ab59-766406f29f3a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:10.226542 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6249178-18a7-4cea-ab59-766406f29f3a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:10.226985 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6249178-18a7-4cea-ab59-766406f29f3a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:10.227781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6249178-18a7-4cea-ab59-766406f29f3a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:10.228246 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6249178-18a7-4cea-ab59-766406f29f3a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:10.228672 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6249178-18a7-4cea-ab59-766406f29f3a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:10.371148 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c6249178-18a7-4cea-ab59-766406f29f3a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:10.379784 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c6249178-18a7-4cea-ab59-766406f29f3a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.170389 Sep 23 14:09:10.380450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 380/765] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:10 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:09:10.486384 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-06095630-6058-4c80-9e19-17b916e9956e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:10.486894 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-06095630-6058-4c80-9e19-17b916e9956e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:10.492738 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06095630-6058-4c80-9e19-17b916e9956e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:10.493230 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06095630-6058-4c80-9e19-17b916e9956e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:10.493662 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06095630-6058-4c80-9e19-17b916e9956e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:10.494579 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06095630-6058-4c80-9e19-17b916e9956e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:10.495202 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06095630-6058-4c80-9e19-17b916e9956e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:10.495635 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-06095630-6058-4c80-9e19-17b916e9956e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:10.519695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-06095630-6058-4c80-9e19-17b916e9956e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] HTTP exception thrown: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-06095630-6058-4c80-9e19-17b916e9956e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Request method failure captured: Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: DELETE /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 HTTP/1.1 Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxrzANyu0HiE-RI6YrwV4d8fV10ylWEIATegCXV8WUB95m5oAKUEypeFaRSmFIPzbJ8OQMl6Aud1_-7wjU4ZO6GDRxJPylRi9sW9fsJGE2eeMrNRP5hVeqDi3IdZCENn82q0KEmt_9wVferpVh22qvGQNXZFPNp1vMViuNoGirJUN4 Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:09:10.521244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:09:10.522817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_482490c45ac64607bba9ad021f2effbf"}]}] Sep 23 14:09:10.522817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:10.522817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:10.522817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:10.522817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:10.522817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:09:10.522817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:09:10.522817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 0db30f990aae49fabf9b8b19cd019de9 Sep 23 14:09:10.522817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:10.522817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:09:10.522817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:09:10.522817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': 'eee99559-a86f-4088-9fd1-a6ae97245d92'} Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:09:10.523675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:09:10.525227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.526622 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-06095630-6058-4c80-9e19-17b916e9956e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Returning 404 to user: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:09:10.526622 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-06095630-6058-4c80-9e19-17b916e9956e tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 404 len: 111 microversion: 2.1 time: 0.040604 Sep 23 14:09:10.526622 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 386/766] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:09:10 2022] DELETE /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:09:10.532644 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b95ef493-83ce-4ec6-a310-187b529a071f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:10.533320 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b95ef493-83ce-4ec6-a310-187b529a071f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: eee99559-a86f-4088-9fd1-a6ae97245d92] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:10.539464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b95ef493-83ce-4ec6-a310-187b529a071f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:10.542147 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b95ef493-83ce-4ec6-a310-187b529a071f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:10.542147 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b95ef493-83ce-4ec6-a310-187b529a071f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:10.542147 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b95ef493-83ce-4ec6-a310-187b529a071f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:10.542147 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b95ef493-83ce-4ec6-a310-187b529a071f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:10.542610 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b95ef493-83ce-4ec6-a310-187b529a071f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:10.556064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-b95ef493-83ce-4ec6-a310-187b529a071f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] HTTP exception thrown: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b95ef493-83ce-4ec6-a310-187b529a071f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Request method failure captured: Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 HTTP/1.1 Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbxrzANyu0HiE-RI6YrwV4d8fV10ylWEIATegCXV8WUB95m5oAKUEypeFaRSmFIPzbJ8OQMl6Aud1_-7wjU4ZO6GDRxJPylRi9sW9fsJGE2eeMrNRP5hVeqDi3IdZCENn82q0KEmt_9wVferpVh22qvGQNXZFPNp1vMViuNoGirJUN4 Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:09:10.558075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:09:10.565960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_482490c45ac64607bba9ad021f2effbf"}]}] Sep 23 14:09:10.565960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:10.565960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:10.565960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:10.565960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:10.565960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:09:10.565960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:09:10.565960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 0db30f990aae49fabf9b8b19cd019de9 Sep 23 14:09:10.565960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:10.565960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:09:10.565960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:09:10.565960 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': 'eee99559-a86f-4088-9fd1-a6ae97245d92'} Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:09:10.567313 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. Sep 23 14:09:10.568735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.570014 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b95ef493-83ce-4ec6-a310-187b529a071f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Returning 404 to user: Instance eee99559-a86f-4088-9fd1-a6ae97245d92 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:09:10.570014 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b95ef493-83ce-4ec6-a310-187b529a071f tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92" status: 404 len: 111 microversion: 2.1 time: 0.031908 Sep 23 14:09:10.570014 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 381/767] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:10 2022] GET /compute/v2.1/servers/eee99559-a86f-4088-9fd1-a6ae97245d92 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:09:10.570236 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9cbaebf6-7b44-4046-8248-8ab77f675530 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:10.570236 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-9cbaebf6-7b44-4046-8248-8ab77f675530 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:10.570236 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9cbaebf6-7b44-4046-8248-8ab77f675530 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:10.570507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9cbaebf6-7b44-4046-8248-8ab77f675530 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:10.570949 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9cbaebf6-7b44-4046-8248-8ab77f675530 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:10.572086 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9cbaebf6-7b44-4046-8248-8ab77f675530 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:10.572550 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9cbaebf6-7b44-4046-8248-8ab77f675530 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:10.575359 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9cbaebf6-7b44-4046-8248-8ab77f675530 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:10.584333 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a2df747a-4d7a-40fb-b2c2-ffc3c4ff0a39 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:10.584838 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a2df747a-4d7a-40fb-b2c2-ffc3c4ff0a39 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:10.598942 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a2df747a-4d7a-40fb-b2c2-ffc3c4ff0a39 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:10.599714 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a2df747a-4d7a-40fb-b2c2-ffc3c4ff0a39 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:10.600157 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a2df747a-4d7a-40fb-b2c2-ffc3c4ff0a39 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:10.600869 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a2df747a-4d7a-40fb-b2c2-ffc3c4ff0a39 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:10.601328 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a2df747a-4d7a-40fb-b2c2-ffc3c4ff0a39 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:10.602045 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a2df747a-4d7a-40fb-b2c2-ffc3c4ff0a39 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:10.619279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-a2df747a-4d7a-40fb-b2c2-ffc3c4ff0a39 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] HTTP exception thrown: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a2df747a-4d7a-40fb-b2c2-ffc3c4ff0a39 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Request method failure captured: Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: DELETE /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae HTTP/1.1 Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbxrzANyu0HiE-RI6YrwV4d8fV10ylWEIATegCXV8WUB95m5oAKUEypeFaRSmFIPzbJ8OQMl6Aud1_-7wjU4ZO6GDRxJPylRi9sW9fsJGE2eeMrNRP5hVeqDi3IdZCENn82q0KEmt_9wVferpVh22qvGQNXZFPNp1vMViuNoGirJUN4 Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:09:10.620897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:09:10.622528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_482490c45ac64607bba9ad021f2effbf"}]}] Sep 23 14:09:10.622528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:10.622528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:10.622528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:10.622528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:10.622528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:09:10.622528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:09:10.622528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 0db30f990aae49fabf9b8b19cd019de9 Sep 23 14:09:10.622528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:10.622528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:09:10.622528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:09:10.622528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '760e9fcc-3723-43bd-ab9b-db54f81db1ae'} Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:09:10.624047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:09:10.625556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.627168 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a2df747a-4d7a-40fb-b2c2-ffc3c4ff0a39 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Returning 404 to user: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:09:10.627168 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a2df747a-4d7a-40fb-b2c2-ffc3c4ff0a39 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 404 len: 111 microversion: 2.1 time: 0.045220 Sep 23 14:09:10.627168 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 382/768] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:09:10 2022] DELETE /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:09:10.635251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8bb32056-7baf-4647-b969-249bb3937231 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:10.635864 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-8bb32056-7baf-4647-b969-249bb3937231 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 760e9fcc-3723-43bd-ab9b-db54f81db1ae] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:10.646132 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8bb32056-7baf-4647-b969-249bb3937231 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:10.646999 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8bb32056-7baf-4647-b969-249bb3937231 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:10.647625 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8bb32056-7baf-4647-b969-249bb3937231 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:10.649430 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8bb32056-7baf-4647-b969-249bb3937231 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:10.650612 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8bb32056-7baf-4647-b969-249bb3937231 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:10.651501 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8bb32056-7baf-4647-b969-249bb3937231 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:10.670303 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-8bb32056-7baf-4647-b969-249bb3937231 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] HTTP exception thrown: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8bb32056-7baf-4647-b969-249bb3937231 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Request method failure captured: Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae HTTP/1.1 Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbxrzANyu0HiE-RI6YrwV4d8fV10ylWEIATegCXV8WUB95m5oAKUEypeFaRSmFIPzbJ8OQMl6Aud1_-7wjU4ZO6GDRxJPylRi9sW9fsJGE2eeMrNRP5hVeqDi3IdZCENn82q0KEmt_9wVferpVh22qvGQNXZFPNp1vMViuNoGirJUN4 Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:09:10.671877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:09:10.673279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_482490c45ac64607bba9ad021f2effbf"}]}] Sep 23 14:09:10.673279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:10.673279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:10.673279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:10.673279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:10.673279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:09:10.673279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:09:10.673279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 0db30f990aae49fabf9b8b19cd019de9 Sep 23 14:09:10.673279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:10.673279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:09:10.673279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:09:10.673279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '760e9fcc-3723-43bd-ab9b-db54f81db1ae'} Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:09:10.674037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. Sep 23 14:09:10.676279 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:10.677845 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8bb32056-7baf-4647-b969-249bb3937231 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Returning 404 to user: Instance 760e9fcc-3723-43bd-ab9b-db54f81db1ae could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:09:10.677845 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8bb32056-7baf-4647-b969-249bb3937231 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae" status: 404 len: 111 microversion: 2.1 time: 0.045065 Sep 23 14:09:10.677845 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 383/769] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:10 2022] GET /compute/v2.1/servers/760e9fcc-3723-43bd-ab9b-db54f81db1ae => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:09:10.744914 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9cbaebf6-7b44-4046-8248-8ab77f675530 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:10.756130 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9cbaebf6-7b44-4046-8248-8ab77f675530 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:10.757714 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9cbaebf6-7b44-4046-8248-8ab77f675530 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:10.758909 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-9cbaebf6-7b44-4046-8248-8ab77f675530 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.200485 Sep 23 14:09:10.759454 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 387/770] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:10 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:09:11.403655 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-500b5fbb-19fa-46fa-a663-e59586641948 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:11.405067 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-500b5fbb-19fa-46fa-a663-e59586641948 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:11.411686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-500b5fbb-19fa-46fa-a663-e59586641948 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:11.412192 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-500b5fbb-19fa-46fa-a663-e59586641948 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:11.412629 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-500b5fbb-19fa-46fa-a663-e59586641948 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:11.413341 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-500b5fbb-19fa-46fa-a663-e59586641948 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:11.413823 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-500b5fbb-19fa-46fa-a663-e59586641948 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:11.414269 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-500b5fbb-19fa-46fa-a663-e59586641948 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:11.551670 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-500b5fbb-19fa-46fa-a663-e59586641948 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:11.559239 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-500b5fbb-19fa-46fa-a663-e59586641948 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.159588 Sep 23 14:09:11.559799 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 384/771] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:11 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:11.784217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b1c63647-6efd-429e-a6db-8e51b9c23313 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:11.785443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b1c63647-6efd-429e-a6db-8e51b9c23313 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:11.791651 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b1c63647-6efd-429e-a6db-8e51b9c23313 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:11.792305 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b1c63647-6efd-429e-a6db-8e51b9c23313 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:11.792903 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b1c63647-6efd-429e-a6db-8e51b9c23313 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:11.793594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b1c63647-6efd-429e-a6db-8e51b9c23313 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:11.794045 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b1c63647-6efd-429e-a6db-8e51b9c23313 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:11.794553 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b1c63647-6efd-429e-a6db-8e51b9c23313 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:11.811982 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:12.000178 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b1c63647-6efd-429e-a6db-8e51b9c23313 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:12.008859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b1c63647-6efd-429e-a6db-8e51b9c23313 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:12.010391 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b1c63647-6efd-429e-a6db-8e51b9c23313 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:12.011760 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b1c63647-6efd-429e-a6db-8e51b9c23313 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.231349 Sep 23 14:09:12.012311 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 388/772] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:11 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:12.023156 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-70c1d17a-1763-46f3-9203-e3dc7b183c3c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:12.023650 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-70c1d17a-1763-46f3-9203-e3dc7b183c3c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:12.030924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70c1d17a-1763-46f3-9203-e3dc7b183c3c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:12.031420 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70c1d17a-1763-46f3-9203-e3dc7b183c3c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:12.031862 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70c1d17a-1763-46f3-9203-e3dc7b183c3c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:12.032562 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70c1d17a-1763-46f3-9203-e3dc7b183c3c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:12.033077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70c1d17a-1763-46f3-9203-e3dc7b183c3c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:12.033507 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70c1d17a-1763-46f3-9203-e3dc7b183c3c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:12.049547 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-70c1d17a-1763-46f3-9203-e3dc7b183c3c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] HTTP exception thrown: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-70c1d17a-1763-46f3-9203-e3dc7b183c3c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Request method failure captured: Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: DELETE /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b HTTP/1.1 Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbxrzANyu0HiE-RI6YrwV4d8fV10ylWEIATegCXV8WUB95m5oAKUEypeFaRSmFIPzbJ8OQMl6Aud1_-7wjU4ZO6GDRxJPylRi9sW9fsJGE2eeMrNRP5hVeqDi3IdZCENn82q0KEmt_9wVferpVh22qvGQNXZFPNp1vMViuNoGirJUN4 Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:09:12.053077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:09:12.054746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_482490c45ac64607bba9ad021f2effbf"}]}] Sep 23 14:09:12.054746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:12.054746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:12.054746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:12.054746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:12.054746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:09:12.054746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:09:12.054746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 0db30f990aae49fabf9b8b19cd019de9 Sep 23 14:09:12.054746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:12.054746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:09:12.054746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:09:12.054746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '3b6d10ec-d6f4-4d14-939c-beab0c9ba13b'} Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:09:12.055608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:09:12.057816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:09:12.059143 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-70c1d17a-1763-46f3-9203-e3dc7b183c3c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Returning 404 to user: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:09:12.059143 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-70c1d17a-1763-46f3-9203-e3dc7b183c3c tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 404 len: 111 microversion: 2.1 time: 0.033949 Sep 23 14:09:12.059143 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 385/773] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:09:12 2022] DELETE /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 14:09:12.067087 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-44dc434f-fb00-44cd-8e9e-638af5289793 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:12.067834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-44dc434f-fb00-44cd-8e9e-638af5289793 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] [instance: 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:12.083371 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-44dc434f-fb00-44cd-8e9e-638af5289793 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:12.084150 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-44dc434f-fb00-44cd-8e9e-638af5289793 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:12.084801 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-44dc434f-fb00-44cd-8e9e-638af5289793 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:12.085693 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-44dc434f-fb00-44cd-8e9e-638af5289793 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:12.086376 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-44dc434f-fb00-44cd-8e9e-638af5289793 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:12.086953 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-44dc434f-fb00-44cd-8e9e-638af5289793 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:12.103527 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-44dc434f-fb00-44cd-8e9e-638af5289793 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] HTTP exception thrown: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-44dc434f-fb00-44cd-8e9e-638af5289793 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Request method failure captured: Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b HTTP/1.1 Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbxrzANyu0HiE-RI6YrwV4d8fV10ylWEIATegCXV8WUB95m5oAKUEypeFaRSmFIPzbJ8OQMl6Aud1_-7wjU4ZO6GDRxJPylRi9sW9fsJGE2eeMrNRP5hVeqDi3IdZCENn82q0KEmt_9wVferpVh22qvGQNXZFPNp1vMViuNoGirJUN4 Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:09:12.105162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:09:12.112136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/482490c45ac64607bba9ad021f2effbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_482490c45ac64607bba9ad021f2effbf"}]}] Sep 23 14:09:12.112136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:12.112136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 482490c45ac64607bba9ad021f2effbf Sep 23 14:09:12.112136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1878946497 Sep 23 14:09:12.112136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:12.112136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:09:12.112136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:09:12.112136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 0db30f990aae49fabf9b8b19cd019de9 Sep 23 14:09:12.112136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-AttachVolumeNegativeTest-1878946497-project Sep 23 14:09:12.112136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:09:12.112136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:09:12.112136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': '3b6d10ec-d6f4-4d14-939c-beab0c9ba13b'} Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:09:12.113036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. Sep 23 14:09:12.114488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:09:12.115765 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-44dc434f-fb00-44cd-8e9e-638af5289793 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] Returning 404 to user: Instance 3b6d10ec-d6f4-4d14-939c-beab0c9ba13b could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:09:12.115765 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-44dc434f-fb00-44cd-8e9e-638af5289793 tempest-AttachVolumeNegativeTest-1878946497 tempest-AttachVolumeNegativeTest-1878946497-project] 10.222.0.62 "GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b" status: 404 len: 111 microversion: 2.1 time: 0.044572 Sep 23 14:09:12.115765 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 389/774] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:12 2022] GET /compute/v2.1/servers/3b6d10ec-d6f4-4d14-939c-beab0c9ba13b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:09:12.583316 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-28f55d58-3c8f-4b78-a19d-d760bcef03a6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:12.584567 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-28f55d58-3c8f-4b78-a19d-d760bcef03a6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:12.591030 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28f55d58-3c8f-4b78-a19d-d760bcef03a6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:12.592039 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28f55d58-3c8f-4b78-a19d-d760bcef03a6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:12.592466 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28f55d58-3c8f-4b78-a19d-d760bcef03a6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:12.593157 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28f55d58-3c8f-4b78-a19d-d760bcef03a6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:12.593608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28f55d58-3c8f-4b78-a19d-d760bcef03a6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:12.594028 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-28f55d58-3c8f-4b78-a19d-d760bcef03a6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:12.753464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-28f55d58-3c8f-4b78-a19d-d760bcef03a6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:12.781057 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-28f55d58-3c8f-4b78-a19d-d760bcef03a6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.184121 Sep 23 14:09:12.781057 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 386/775] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:12 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:09:13.039496 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ad0e731e-26dd-40c0-a1a1-02ba526bc8cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:13.040115 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ad0e731e-26dd-40c0-a1a1-02ba526bc8cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:13.047427 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ad0e731e-26dd-40c0-a1a1-02ba526bc8cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:13.047986 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ad0e731e-26dd-40c0-a1a1-02ba526bc8cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:13.048422 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ad0e731e-26dd-40c0-a1a1-02ba526bc8cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:13.049152 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ad0e731e-26dd-40c0-a1a1-02ba526bc8cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:13.049625 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ad0e731e-26dd-40c0-a1a1-02ba526bc8cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:13.050051 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ad0e731e-26dd-40c0-a1a1-02ba526bc8cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:13.271092 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ad0e731e-26dd-40c0-a1a1-02ba526bc8cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:13.287520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ad0e731e-26dd-40c0-a1a1-02ba526bc8cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:13.293319 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ad0e731e-26dd-40c0-a1a1-02ba526bc8cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:13.298201 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ad0e731e-26dd-40c0-a1a1-02ba526bc8cd tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.259359 Sep 23 14:09:13.298201 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 390/776] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:13 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:13.788723 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e07641db-2133-42aa-b394-8f9bff7a2d60 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:13.789443 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e07641db-2133-42aa-b394-8f9bff7a2d60 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:13.816430 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e07641db-2133-42aa-b394-8f9bff7a2d60 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:13.821467 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e07641db-2133-42aa-b394-8f9bff7a2d60 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:13.821921 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e07641db-2133-42aa-b394-8f9bff7a2d60 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:13.822968 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e07641db-2133-42aa-b394-8f9bff7a2d60 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:13.839109 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e07641db-2133-42aa-b394-8f9bff7a2d60 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:13.853524 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e07641db-2133-42aa-b394-8f9bff7a2d60 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:14.065565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e07641db-2133-42aa-b394-8f9bff7a2d60 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:14.083783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e07641db-2133-42aa-b394-8f9bff7a2d60 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.296332 Sep 23 14:09:14.084536 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 387/777] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:13 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:14.327639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6e7cf0cc-2184-4164-83b9-d783b42d66c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:14.327639 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6e7cf0cc-2184-4164-83b9-d783b42d66c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:14.347192 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e7cf0cc-2184-4164-83b9-d783b42d66c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:14.347701 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e7cf0cc-2184-4164-83b9-d783b42d66c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:14.348142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e7cf0cc-2184-4164-83b9-d783b42d66c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:14.349470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e7cf0cc-2184-4164-83b9-d783b42d66c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:14.349470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e7cf0cc-2184-4164-83b9-d783b42d66c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:14.349703 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6e7cf0cc-2184-4164-83b9-d783b42d66c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:14.633122 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6e7cf0cc-2184-4164-83b9-d783b42d66c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:14.644269 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6e7cf0cc-2184-4164-83b9-d783b42d66c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:14.660781 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6e7cf0cc-2184-4164-83b9-d783b42d66c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:14.660781 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6e7cf0cc-2184-4164-83b9-d783b42d66c6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.325526 Sep 23 14:09:14.660781 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 391/778] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:14 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:15.117637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-436c7518-32bd-43e6-84f9-417c95ee9012 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:15.123254 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-436c7518-32bd-43e6-84f9-417c95ee9012 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:15.141125 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-436c7518-32bd-43e6-84f9-417c95ee9012 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:15.141908 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-436c7518-32bd-43e6-84f9-417c95ee9012 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:15.142559 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-436c7518-32bd-43e6-84f9-417c95ee9012 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:15.143433 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-436c7518-32bd-43e6-84f9-417c95ee9012 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:15.144041 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-436c7518-32bd-43e6-84f9-417c95ee9012 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:15.144615 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-436c7518-32bd-43e6-84f9-417c95ee9012 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:15.486750 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-436c7518-32bd-43e6-84f9-417c95ee9012 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:15.496438 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-436c7518-32bd-43e6-84f9-417c95ee9012 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.382666 Sep 23 14:09:15.498214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 388/779] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:15 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:15.674712 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-207800ec-53fc-48b4-81ec-05a78f4b27e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:15.676076 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-207800ec-53fc-48b4-81ec-05a78f4b27e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:15.688841 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-207800ec-53fc-48b4-81ec-05a78f4b27e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:15.689543 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-207800ec-53fc-48b4-81ec-05a78f4b27e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:15.690402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-207800ec-53fc-48b4-81ec-05a78f4b27e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:15.691385 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-207800ec-53fc-48b4-81ec-05a78f4b27e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:15.691910 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-207800ec-53fc-48b4-81ec-05a78f4b27e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:15.692399 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-207800ec-53fc-48b4-81ec-05a78f4b27e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:15.913746 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-207800ec-53fc-48b4-81ec-05a78f4b27e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:15.946907 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-207800ec-53fc-48b4-81ec-05a78f4b27e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:15.948764 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-207800ec-53fc-48b4-81ec-05a78f4b27e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:15.950016 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-207800ec-53fc-48b4-81ec-05a78f4b27e6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.279172 Sep 23 14:09:15.953959 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 392/780] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:15 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:16.524913 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3d4cfcd6-e145-4e04-a0f1-723dd22da85d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:16.526466 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3d4cfcd6-e145-4e04-a0f1-723dd22da85d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:16.539000 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3d4cfcd6-e145-4e04-a0f1-723dd22da85d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:16.547337 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3d4cfcd6-e145-4e04-a0f1-723dd22da85d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:16.547798 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3d4cfcd6-e145-4e04-a0f1-723dd22da85d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:16.548547 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3d4cfcd6-e145-4e04-a0f1-723dd22da85d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:16.549007 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3d4cfcd6-e145-4e04-a0f1-723dd22da85d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:16.549431 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3d4cfcd6-e145-4e04-a0f1-723dd22da85d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:16.875386 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3d4cfcd6-e145-4e04-a0f1-723dd22da85d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:16.886200 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3d4cfcd6-e145-4e04-a0f1-723dd22da85d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.365755 Sep 23 14:09:16.887032 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 389/781] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:16 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:16.976474 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6fb1d60b-8c2d-41d1-b296-e31e501ee96c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:16.977086 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6fb1d60b-8c2d-41d1-b296-e31e501ee96c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:16.987870 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fb1d60b-8c2d-41d1-b296-e31e501ee96c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:16.988439 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fb1d60b-8c2d-41d1-b296-e31e501ee96c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:16.988881 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fb1d60b-8c2d-41d1-b296-e31e501ee96c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:16.989593 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fb1d60b-8c2d-41d1-b296-e31e501ee96c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:16.990251 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fb1d60b-8c2d-41d1-b296-e31e501ee96c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:16.995118 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fb1d60b-8c2d-41d1-b296-e31e501ee96c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:17.235204 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6fb1d60b-8c2d-41d1-b296-e31e501ee96c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:17.266533 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6fb1d60b-8c2d-41d1-b296-e31e501ee96c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:17.273331 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6fb1d60b-8c2d-41d1-b296-e31e501ee96c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:17.278005 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6fb1d60b-8c2d-41d1-b296-e31e501ee96c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.305335 Sep 23 14:09:17.300762 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 393/782] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:16 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:17.913263 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-2b674d6e-e4af-44c9-8635-5994a5e9dccb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:17.913802 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-2b674d6e-e4af-44c9-8635-5994a5e9dccb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:17.923980 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2b674d6e-e4af-44c9-8635-5994a5e9dccb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:17.924570 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2b674d6e-e4af-44c9-8635-5994a5e9dccb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:17.925054 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2b674d6e-e4af-44c9-8635-5994a5e9dccb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:17.928828 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2b674d6e-e4af-44c9-8635-5994a5e9dccb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:17.929596 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2b674d6e-e4af-44c9-8635-5994a5e9dccb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:17.930033 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2b674d6e-e4af-44c9-8635-5994a5e9dccb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:18.314293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ff84bb33-9913-4255-bd84-76728c8620be tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:18.316106 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ff84bb33-9913-4255-bd84-76728c8620be tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:18.331277 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff84bb33-9913-4255-bd84-76728c8620be tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:18.335231 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff84bb33-9913-4255-bd84-76728c8620be tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:18.335231 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff84bb33-9913-4255-bd84-76728c8620be tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:18.335231 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff84bb33-9913-4255-bd84-76728c8620be tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:18.335231 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff84bb33-9913-4255-bd84-76728c8620be tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:18.335728 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff84bb33-9913-4255-bd84-76728c8620be tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:18.420252 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-2b674d6e-e4af-44c9-8635-5994a5e9dccb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:18.431159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-2b674d6e-e4af-44c9-8635-5994a5e9dccb tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.522214 Sep 23 14:09:18.432958 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 390/783] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:17 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:18.473076 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-e79419e4-20bd-403f-9a49-93f464b1afc7 req-23c07f14-4cd4-4ca6-a75d-bd3e27f7d752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3cf38f-b2d0-465c-9f91-7b04e669be1a", "name": "network-vif-plugged", "status": "completed", "tag": "ddb61f77-2e1f-4d02-bd20-42e3ca25c62d"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:09:18.486055 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-e79419e4-20bd-403f-9a49-93f464b1afc7 req-23c07f14-4cd4-4ca6-a75d-bd3e27f7d752 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:18.486939 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-e79419e4-20bd-403f-9a49-93f464b1afc7 req-23c07f14-4cd4-4ca6-a75d-bd3e27f7d752 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:18.487627 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-e79419e4-20bd-403f-9a49-93f464b1afc7 req-23c07f14-4cd4-4ca6-a75d-bd3e27f7d752 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:18.503181 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-e79419e4-20bd-403f-9a49-93f464b1afc7 req-23c07f14-4cd4-4ca6-a75d-bd3e27f7d752 service nova] Creating event network-vif-plugged:ddb61f77-2e1f-4d02-bd20-42e3ca25c62d for instance ae3cf38f-b2d0-465c-9f91-7b04e669be1a on hv-cinder-85743 Sep 23 14:09:18.509475 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-e79419e4-20bd-403f-9a49-93f464b1afc7 req-23c07f14-4cd4-4ca6-a75d-bd3e27f7d752 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040863 Sep 23 14:09:18.510826 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 391/784] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:09:18.977274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ff84bb33-9913-4255-bd84-76728c8620be tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:18.986741 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ff84bb33-9913-4255-bd84-76728c8620be tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:18.988347 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ff84bb33-9913-4255-bd84-76728c8620be tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:18.990618 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ff84bb33-9913-4255-bd84-76728c8620be tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.682729 Sep 23 14:09:18.991587 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 394/785] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:18 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:19.461071 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b501cac7-c528-423b-b89a-131598ee4cdd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:19.462071 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b501cac7-c528-423b-b89a-131598ee4cdd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:19.470521 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b501cac7-c528-423b-b89a-131598ee4cdd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:19.471016 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b501cac7-c528-423b-b89a-131598ee4cdd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:19.474008 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b501cac7-c528-423b-b89a-131598ee4cdd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:19.474008 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b501cac7-c528-423b-b89a-131598ee4cdd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:19.474008 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b501cac7-c528-423b-b89a-131598ee4cdd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:19.474008 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b501cac7-c528-423b-b89a-131598ee4cdd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:19.493162 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:19.620131 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b501cac7-c528-423b-b89a-131598ee4cdd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:19.629857 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b501cac7-c528-423b-b89a-131598ee4cdd tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.174399 Sep 23 14:09:19.630608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 392/786] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:19 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:20.035719 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8ba96705-da18-41ef-8aea-29091f8b43ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:20.043209 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8ba96705-da18-41ef-8aea-29091f8b43ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:20.057397 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8ba96705-da18-41ef-8aea-29091f8b43ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:20.057397 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8ba96705-da18-41ef-8aea-29091f8b43ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:20.057397 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8ba96705-da18-41ef-8aea-29091f8b43ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:20.081144 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8ba96705-da18-41ef-8aea-29091f8b43ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:20.081144 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8ba96705-da18-41ef-8aea-29091f8b43ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:20.081144 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8ba96705-da18-41ef-8aea-29091f8b43ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:20.319577 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8ba96705-da18-41ef-8aea-29091f8b43ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:20.329510 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8ba96705-da18-41ef-8aea-29091f8b43ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:20.331286 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8ba96705-da18-41ef-8aea-29091f8b43ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:20.333335 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8ba96705-da18-41ef-8aea-29091f8b43ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.310865 Sep 23 14:09:20.335445 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 395/787] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:20 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:20.653247 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-36834cc9-4cf8-4eb1-8b24-6bc7a2bd8b5c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:20.655067 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-36834cc9-4cf8-4eb1-8b24-6bc7a2bd8b5c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:20.662820 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36834cc9-4cf8-4eb1-8b24-6bc7a2bd8b5c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:20.666307 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36834cc9-4cf8-4eb1-8b24-6bc7a2bd8b5c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:20.666307 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36834cc9-4cf8-4eb1-8b24-6bc7a2bd8b5c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:20.666307 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36834cc9-4cf8-4eb1-8b24-6bc7a2bd8b5c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:20.666307 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36834cc9-4cf8-4eb1-8b24-6bc7a2bd8b5c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:20.666834 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36834cc9-4cf8-4eb1-8b24-6bc7a2bd8b5c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:20.827719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-36834cc9-4cf8-4eb1-8b24-6bc7a2bd8b5c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:20.836045 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-36834cc9-4cf8-4eb1-8b24-6bc7a2bd8b5c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.186939 Sep 23 14:09:20.836643 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 393/788] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:20 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:21.362585 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a1b306fb-96ef-4f18-b482-a52395a65d63 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:21.363320 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a1b306fb-96ef-4f18-b482-a52395a65d63 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:21.371547 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a1b306fb-96ef-4f18-b482-a52395a65d63 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:21.375707 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a1b306fb-96ef-4f18-b482-a52395a65d63 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:21.375707 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a1b306fb-96ef-4f18-b482-a52395a65d63 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:21.375707 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a1b306fb-96ef-4f18-b482-a52395a65d63 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:21.375707 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a1b306fb-96ef-4f18-b482-a52395a65d63 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:21.376069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a1b306fb-96ef-4f18-b482-a52395a65d63 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:21.610832 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a1b306fb-96ef-4f18-b482-a52395a65d63 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:21.610832 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a1b306fb-96ef-4f18-b482-a52395a65d63 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:21.611103 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a1b306fb-96ef-4f18-b482-a52395a65d63 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:21.611103 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a1b306fb-96ef-4f18-b482-a52395a65d63 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.228870 Sep 23 14:09:21.611103 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 396/789] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:21 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:21.860579 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-70f1a3fd-d3e4-496d-b321-ef6bd037ffd9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:21.861144 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-70f1a3fd-d3e4-496d-b321-ef6bd037ffd9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:21.868728 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70f1a3fd-d3e4-496d-b321-ef6bd037ffd9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:21.869515 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70f1a3fd-d3e4-496d-b321-ef6bd037ffd9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:21.869959 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70f1a3fd-d3e4-496d-b321-ef6bd037ffd9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:21.874438 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70f1a3fd-d3e4-496d-b321-ef6bd037ffd9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:21.874438 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70f1a3fd-d3e4-496d-b321-ef6bd037ffd9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:21.874438 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70f1a3fd-d3e4-496d-b321-ef6bd037ffd9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:21.880383 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-236171928", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1637587475", "security_groups": [{"name": "tempest-secgroup-smoke-195226751"}], "block_device_mapping_v2": [{"uuid": "95be79fb-a283-44cd-82ab-2eefce960177", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "85b65927-108e-4662-8841-432429780256"}]}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:09:22.050779 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-70f1a3fd-d3e4-496d-b321-ef6bd037ffd9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:22.053464 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.network.neutron [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] validate_networks() for [('85b65927-108e-4662-8841-432429780256', None, None, None, None, None)] {{(pid=121074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:09:22.059359 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-70f1a3fd-d3e4-496d-b321-ef6bd037ffd9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.203272 Sep 23 14:09:22.059948 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 394/790] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:21 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:22.489200 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Flavor limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:09:22.489709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Image limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:09:22.490075 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Flavor pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:09:22.490516 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Image pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:09:22.490925 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:09:22.499649 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:22.500137 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:22.500576 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:22.501293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:22.501743 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:22.502253 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:22.518817 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Getting quotas for project 901178273d85449e9cdaa5de235fb3e9. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:09:22.522837 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Getting quotas for user 9359e90c4861470d9cc060abb9c3b203 and project 901178273d85449e9cdaa5de235fb3e9. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:09:22.581597 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Going to run 1 instances... {{(pid=121074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:09:22.583997 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='95be79fb-a283-44cd-82ab-2eefce960177',volume_size=None,volume_type=None)] {{(pid=121074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:09:22.645624 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4f5a26ad-ad2b-4618-8085-009db3ff113c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:22.645624 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4f5a26ad-ad2b-4618-8085-009db3ff113c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:22.645624 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4f5a26ad-ad2b-4618-8085-009db3ff113c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:22.645624 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4f5a26ad-ad2b-4618-8085-009db3ff113c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:22.646583 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4f5a26ad-ad2b-4618-8085-009db3ff113c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:22.646583 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4f5a26ad-ad2b-4618-8085-009db3ff113c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:22.646583 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4f5a26ad-ad2b-4618-8085-009db3ff113c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:22.646583 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4f5a26ad-ad2b-4618-8085-009db3ff113c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:22.780443 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4f5a26ad-ad2b-4618-8085-009db3ff113c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:22.788484 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4f5a26ad-ad2b-4618-8085-009db3ff113c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:22.789911 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4f5a26ad-ad2b-4618-8085-009db3ff113c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:22.791115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4f5a26ad-ad2b-4618-8085-009db3ff113c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.162150 Sep 23 14:09:22.791673 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 395/791] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:22 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:09:23.084760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a7947fce-4a9e-47e2-9135-5c45cc183404 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:23.085380 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a7947fce-4a9e-47e2-9135-5c45cc183404 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:23.099781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a7947fce-4a9e-47e2-9135-5c45cc183404 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:23.099781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a7947fce-4a9e-47e2-9135-5c45cc183404 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:23.099781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a7947fce-4a9e-47e2-9135-5c45cc183404 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:23.099781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a7947fce-4a9e-47e2-9135-5c45cc183404 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:23.100188 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a7947fce-4a9e-47e2-9135-5c45cc183404 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:23.100188 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a7947fce-4a9e-47e2-9135-5c45cc183404 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:23.133012 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7012d747-bec3-4253-9f02-fa0b91dfc5b2 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.256415 Sep 23 14:09:23.133787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 397/792] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:09:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 14:09:23.149763 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fa77f4e8-9f6e-4253-a140-430bc3435e13 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:23.150429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-fa77f4e8-9f6e-4253-a140-430bc3435e13 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:23.270005 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fa77f4e8-9f6e-4253-a140-430bc3435e13 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:23.280620 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fa77f4e8-9f6e-4253-a140-430bc3435e13 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1094 microversion: 2.1 time: 0.139055 Sep 23 14:09:23.286490 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 398/793] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:23 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1094 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:23.326403 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a7947fce-4a9e-47e2-9135-5c45cc183404 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:23.338037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a7947fce-4a9e-47e2-9135-5c45cc183404 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.257008 Sep 23 14:09:23.338657 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 396/794] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:23 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:09:23.817378 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d7dd02f6-b1e6-40fa-a8a3-232ca474da58 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:23.818017 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d7dd02f6-b1e6-40fa-a8a3-232ca474da58 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:23.823941 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d7dd02f6-b1e6-40fa-a8a3-232ca474da58 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:23.824425 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d7dd02f6-b1e6-40fa-a8a3-232ca474da58 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:23.824857 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d7dd02f6-b1e6-40fa-a8a3-232ca474da58 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:23.825568 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d7dd02f6-b1e6-40fa-a8a3-232ca474da58 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:23.826121 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d7dd02f6-b1e6-40fa-a8a3-232ca474da58 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:23.826575 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d7dd02f6-b1e6-40fa-a8a3-232ca474da58 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:24.018402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d7dd02f6-b1e6-40fa-a8a3-232ca474da58 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:24.029324 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d7dd02f6-b1e6-40fa-a8a3-232ca474da58 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:24.031988 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d7dd02f6-b1e6-40fa-a8a3-232ca474da58 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:24.032241 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d7dd02f6-b1e6-40fa-a8a3-232ca474da58 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.219076 Sep 23 14:09:24.033260 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 399/795] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:23 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:24.304529 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4a4f4d77-a3fb-49e0-bd83-99f8e9ed687c tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:24.305141 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4a4f4d77-a3fb-49e0-bd83-99f8e9ed687c tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:24.312765 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a4f4d77-a3fb-49e0-bd83-99f8e9ed687c tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:24.313249 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a4f4d77-a3fb-49e0-bd83-99f8e9ed687c tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:24.313685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a4f4d77-a3fb-49e0-bd83-99f8e9ed687c tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:24.314496 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a4f4d77-a3fb-49e0-bd83-99f8e9ed687c tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:24.314966 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a4f4d77-a3fb-49e0-bd83-99f8e9ed687c tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:24.315390 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a4f4d77-a3fb-49e0-bd83-99f8e9ed687c tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:24.361509 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-c6c78d87-d4bd-4902-922a-a642f3b0275b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:24.362519 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-c6c78d87-d4bd-4902-922a-a642f3b0275b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:24.368545 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c6c78d87-d4bd-4902-922a-a642f3b0275b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:24.369118 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c6c78d87-d4bd-4902-922a-a642f3b0275b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:24.369629 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c6c78d87-d4bd-4902-922a-a642f3b0275b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:24.370427 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c6c78d87-d4bd-4902-922a-a642f3b0275b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:24.370985 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c6c78d87-d4bd-4902-922a-a642f3b0275b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:24.371485 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c6c78d87-d4bd-4902-922a-a642f3b0275b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:24.378917 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4a4f4d77-a3fb-49e0-bd83-99f8e9ed687c tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:24.386763 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4a4f4d77-a3fb-49e0-bd83-99f8e9ed687c tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1144 microversion: 2.1 time: 0.086406 Sep 23 14:09:24.391271 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 397/796] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:24 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:24.522166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-c6c78d87-d4bd-4902-922a-a642f3b0275b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:24.530892 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-c6c78d87-d4bd-4902-922a-a642f3b0275b tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1575 microversion: 2.1 time: 0.173757 Sep 23 14:09:24.546549 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 400/797] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:24 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:09:25.059534 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-2e9a7385-4701-46da-8fe3-fb2931e31d4c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:25.063345 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-2e9a7385-4701-46da-8fe3-fb2931e31d4c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:25.073497 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2e9a7385-4701-46da-8fe3-fb2931e31d4c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:25.080531 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2e9a7385-4701-46da-8fe3-fb2931e31d4c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:25.080531 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2e9a7385-4701-46da-8fe3-fb2931e31d4c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:25.080531 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2e9a7385-4701-46da-8fe3-fb2931e31d4c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:25.080531 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2e9a7385-4701-46da-8fe3-fb2931e31d4c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:25.080962 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2e9a7385-4701-46da-8fe3-fb2931e31d4c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:25.244284 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-2e9a7385-4701-46da-8fe3-fb2931e31d4c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:25.253694 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-2e9a7385-4701-46da-8fe3-fb2931e31d4c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:25.256335 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-2e9a7385-4701-46da-8fe3-fb2931e31d4c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:25.258124 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-2e9a7385-4701-46da-8fe3-fb2931e31d4c tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.202926 Sep 23 14:09:25.258646 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 398/798] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:25 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:25.410430 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4f5015a9-5549-4b13-8082-a3685feeffbe tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:25.411254 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4f5015a9-5549-4b13-8082-a3685feeffbe tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:25.421838 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4f5015a9-5549-4b13-8082-a3685feeffbe tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:25.423423 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4f5015a9-5549-4b13-8082-a3685feeffbe tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:25.424420 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4f5015a9-5549-4b13-8082-a3685feeffbe tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:25.425212 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4f5015a9-5549-4b13-8082-a3685feeffbe tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:25.425766 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4f5015a9-5549-4b13-8082-a3685feeffbe tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:25.426271 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4f5015a9-5549-4b13-8082-a3685feeffbe tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:25.488616 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4f5015a9-5549-4b13-8082-a3685feeffbe tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:25.496173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4f5015a9-5549-4b13-8082-a3685feeffbe tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1136 microversion: 2.1 time: 0.090860 Sep 23 14:09:25.497816 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 401/799] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:25 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1136 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:25.554043 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5a328fa4-8cd2-4435-8d7b-cb61d04f56d6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:25.554786 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5a328fa4-8cd2-4435-8d7b-cb61d04f56d6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:25.562076 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5a328fa4-8cd2-4435-8d7b-cb61d04f56d6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:25.562524 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5a328fa4-8cd2-4435-8d7b-cb61d04f56d6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:25.563204 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5a328fa4-8cd2-4435-8d7b-cb61d04f56d6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:25.563839 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5a328fa4-8cd2-4435-8d7b-cb61d04f56d6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:25.564464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5a328fa4-8cd2-4435-8d7b-cb61d04f56d6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:25.565060 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5a328fa4-8cd2-4435-8d7b-cb61d04f56d6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:25.710569 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5a328fa4-8cd2-4435-8d7b-cb61d04f56d6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:25.718245 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5a328fa4-8cd2-4435-8d7b-cb61d04f56d6 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1562 microversion: 2.1 time: 0.167977 Sep 23 14:09:25.718840 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 399/800] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:25 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:26.263148 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-9bb84555-071f-45f9-8be6-c7093bb3eb3d req-6e85c63c-bf28-491a-948c-cf70266e64a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49eff20-f8a6-404b-b09c-def6e4c167ca", "name": "network-vif-plugged", "status": "completed", "tag": "20043706-94ae-416a-96d1-e1f2fc14183b"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:09:26.274444 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-9bb84555-071f-45f9-8be6-c7093bb3eb3d req-6e85c63c-bf28-491a-948c-cf70266e64a6 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:26.274924 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-9bb84555-071f-45f9-8be6-c7093bb3eb3d req-6e85c63c-bf28-491a-948c-cf70266e64a6 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:26.275346 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-9bb84555-071f-45f9-8be6-c7093bb3eb3d req-6e85c63c-bf28-491a-948c-cf70266e64a6 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:26.285377 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-cc11be9e-a97f-42c8-99d6-67054769f3f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:26.285990 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-cc11be9e-a97f-42c8-99d6-67054769f3f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:26.288387 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-9bb84555-071f-45f9-8be6-c7093bb3eb3d req-6e85c63c-bf28-491a-948c-cf70266e64a6 service nova] Creating event network-vif-plugged:20043706-94ae-416a-96d1-e1f2fc14183b for instance c49eff20-f8a6-404b-b09c-def6e4c167ca on hv-cinder-85743 Sep 23 14:09:26.293750 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-9bb84555-071f-45f9-8be6-c7093bb3eb3d req-6e85c63c-bf28-491a-948c-cf70266e64a6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034370 Sep 23 14:09:26.294616 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cc11be9e-a97f-42c8-99d6-67054769f3f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:26.295113 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cc11be9e-a97f-42c8-99d6-67054769f3f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:26.295242 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 402/801] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:09:26.296582 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cc11be9e-a97f-42c8-99d6-67054769f3f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:26.297372 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cc11be9e-a97f-42c8-99d6-67054769f3f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:26.297854 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cc11be9e-a97f-42c8-99d6-67054769f3f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:26.298281 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cc11be9e-a97f-42c8-99d6-67054769f3f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:26.441538 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-cc11be9e-a97f-42c8-99d6-67054769f3f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:26.454468 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-cc11be9e-a97f-42c8-99d6-67054769f3f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:26.455636 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-cc11be9e-a97f-42c8-99d6-67054769f3f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:26.457251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-cc11be9e-a97f-42c8-99d6-67054769f3f7 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.176997 Sep 23 14:09:26.457928 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 400/802] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:26 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:09:26.520507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-c49863f5-e854-422d-80ce-39173ef12147 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:26.521213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-c49863f5-e854-422d-80ce-39173ef12147 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:26.527829 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c49863f5-e854-422d-80ce-39173ef12147 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:26.528521 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c49863f5-e854-422d-80ce-39173ef12147 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:26.528963 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c49863f5-e854-422d-80ce-39173ef12147 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:26.529662 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c49863f5-e854-422d-80ce-39173ef12147 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:26.530701 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c49863f5-e854-422d-80ce-39173ef12147 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:26.531320 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c49863f5-e854-422d-80ce-39173ef12147 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:26.600008 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-c49863f5-e854-422d-80ce-39173ef12147 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:26.608221 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-c49863f5-e854-422d-80ce-39173ef12147 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1192 microversion: 2.1 time: 0.091890 Sep 23 14:09:26.609847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 403/803] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:26 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:27.515311 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e4918fd9-acdb-4f2c-9143-36e888aede65 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:27.515311 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e4918fd9-acdb-4f2c-9143-36e888aede65 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:27.515311 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e4918fd9-acdb-4f2c-9143-36e888aede65 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:27.515311 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e4918fd9-acdb-4f2c-9143-36e888aede65 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:27.516160 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e4918fd9-acdb-4f2c-9143-36e888aede65 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:27.516160 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e4918fd9-acdb-4f2c-9143-36e888aede65 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:27.516160 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e4918fd9-acdb-4f2c-9143-36e888aede65 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:27.516160 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e4918fd9-acdb-4f2c-9143-36e888aede65 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:27.631975 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-eea59e4f-376c-4ce7-809b-a23283f611f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:27.632748 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-eea59e4f-376c-4ce7-809b-a23283f611f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:27.639240 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-eea59e4f-376c-4ce7-809b-a23283f611f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:27.640382 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-eea59e4f-376c-4ce7-809b-a23283f611f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:27.641080 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-eea59e4f-376c-4ce7-809b-a23283f611f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:27.641822 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e4918fd9-acdb-4f2c-9143-36e888aede65 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:27.641979 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-eea59e4f-376c-4ce7-809b-a23283f611f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:27.642357 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-eea59e4f-376c-4ce7-809b-a23283f611f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:27.642843 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-eea59e4f-376c-4ce7-809b-a23283f611f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:27.650301 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e4918fd9-acdb-4f2c-9143-36e888aede65 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:27.651747 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e4918fd9-acdb-4f2c-9143-36e888aede65 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:27.652897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e4918fd9-acdb-4f2c-9143-36e888aede65 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.167857 Sep 23 14:09:27.653456 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 401/804] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:27 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:09:27.710992 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-eea59e4f-376c-4ce7-809b-a23283f611f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:27.719156 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-eea59e4f-376c-4ce7-809b-a23283f611f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1200 microversion: 2.1 time: 0.091735 Sep 23 14:09:27.719725 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 404/805] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:27 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:28.681625 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-79d41c7c-e781-4278-a944-c76ab94ddb09 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:28.682625 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-79d41c7c-e781-4278-a944-c76ab94ddb09 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:28.689739 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-79d41c7c-e781-4278-a944-c76ab94ddb09 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:28.694720 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-79d41c7c-e781-4278-a944-c76ab94ddb09 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:28.694720 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-79d41c7c-e781-4278-a944-c76ab94ddb09 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:28.694720 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-79d41c7c-e781-4278-a944-c76ab94ddb09 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:28.694720 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-79d41c7c-e781-4278-a944-c76ab94ddb09 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:28.695343 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-79d41c7c-e781-4278-a944-c76ab94ddb09 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:28.742774 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-bf0ef038-9b3e-4861-a6ad-429c18094e4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:28.743393 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-bf0ef038-9b3e-4861-a6ad-429c18094e4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:28.749475 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bf0ef038-9b3e-4861-a6ad-429c18094e4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:28.750051 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bf0ef038-9b3e-4861-a6ad-429c18094e4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:28.750523 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bf0ef038-9b3e-4861-a6ad-429c18094e4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:28.751242 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bf0ef038-9b3e-4861-a6ad-429c18094e4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:28.751695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bf0ef038-9b3e-4861-a6ad-429c18094e4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:28.752116 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bf0ef038-9b3e-4861-a6ad-429c18094e4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:28.959687 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-79d41c7c-e781-4278-a944-c76ab94ddb09 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:28.967926 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-79d41c7c-e781-4278-a944-c76ab94ddb09 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:28.969370 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-79d41c7c-e781-4278-a944-c76ab94ddb09 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:28.970569 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-79d41c7c-e781-4278-a944-c76ab94ddb09 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.292910 Sep 23 14:09:28.984452 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 402/806] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:28 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:29.002537 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-bf0ef038-9b3e-4861-a6ad-429c18094e4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:29.010922 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-bf0ef038-9b3e-4861-a6ad-429c18094e4e tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1277 microversion: 2.1 time: 0.272321 Sep 23 14:09:29.011495 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 405/807] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:28 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1277 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:09:29.878454 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-72a3f211-1a67-4905-98c4-822b3cc93b7d req-0f4374b1-b1a2-44f1-addc-50869c94a4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a08d7c5-4906-498e-980d-ec6d35ba8bee", "tag": "bebfb579-fd1e-4f01-81d1-df4839bfbcc5"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:09:29.888500 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-72a3f211-1a67-4905-98c4-822b3cc93b7d req-0f4374b1-b1a2-44f1-addc-50869c94a4f0 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:29.889249 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-72a3f211-1a67-4905-98c4-822b3cc93b7d req-0f4374b1-b1a2-44f1-addc-50869c94a4f0 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:29.890130 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-72a3f211-1a67-4905-98c4-822b3cc93b7d req-0f4374b1-b1a2-44f1-addc-50869c94a4f0 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:29.903224 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-72a3f211-1a67-4905-98c4-822b3cc93b7d req-0f4374b1-b1a2-44f1-addc-50869c94a4f0 service nova] Creating event network-changed:bebfb579-fd1e-4f01-81d1-df4839bfbcc5 for instance 6a08d7c5-4906-498e-980d-ec6d35ba8bee on hv-cinder-85743 Sep 23 14:09:29.909224 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-72a3f211-1a67-4905-98c4-822b3cc93b7d req-0f4374b1-b1a2-44f1-addc-50869c94a4f0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033888 Sep 23 14:09:29.910066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 403/808] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:09:29.999692 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8fd11942-2de3-406a-9f93-bbed0ca8f056 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:30.000312 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8fd11942-2de3-406a-9f93-bbed0ca8f056 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:30.006830 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8fd11942-2de3-406a-9f93-bbed0ca8f056 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:30.011002 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8fd11942-2de3-406a-9f93-bbed0ca8f056 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:30.013523 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8fd11942-2de3-406a-9f93-bbed0ca8f056 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:30.027297 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8fd11942-2de3-406a-9f93-bbed0ca8f056 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:30.028016 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8fd11942-2de3-406a-9f93-bbed0ca8f056 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:30.028619 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8fd11942-2de3-406a-9f93-bbed0ca8f056 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:30.037190 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-13f53d16-eb70-46e7-a220-db60b45f78cb tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:30.037949 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-13f53d16-eb70-46e7-a220-db60b45f78cb tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:30.059483 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-13f53d16-eb70-46e7-a220-db60b45f78cb tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:30.060578 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-13f53d16-eb70-46e7-a220-db60b45f78cb tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:30.061674 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-13f53d16-eb70-46e7-a220-db60b45f78cb tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:30.062652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-13f53d16-eb70-46e7-a220-db60b45f78cb tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:30.063744 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-13f53d16-eb70-46e7-a220-db60b45f78cb tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:30.064373 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-13f53d16-eb70-46e7-a220-db60b45f78cb tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:30.649049 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-13f53d16-eb70-46e7-a220-db60b45f78cb tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:30.649275 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8fd11942-2de3-406a-9f93-bbed0ca8f056 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:30.655481 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-13f53d16-eb70-46e7-a220-db60b45f78cb tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1277 microversion: 2.1 time: 0.623578 Sep 23 14:09:30.656202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 404/809] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:30 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1277 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:09:30.659686 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8fd11942-2de3-406a-9f93-bbed0ca8f056 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:30.661330 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8fd11942-2de3-406a-9f93-bbed0ca8f056 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:30.662647 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8fd11942-2de3-406a-9f93-bbed0ca8f056 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1730 microversion: 2.20 time: 0.668906 Sep 23 14:09:30.663666 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 406/810] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:29 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1730 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:31.678899 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-dfa5916e-9916-4c31-8e17-59d099a09672 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:31.679734 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-dfa5916e-9916-4c31-8e17-59d099a09672 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:31.688793 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-3660f239-7199-4aaa-aec1-1e8cf5d49134 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:31.689268 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:31.689402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-3660f239-7199-4aaa-aec1-1e8cf5d49134 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:31.691071 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dfa5916e-9916-4c31-8e17-59d099a09672 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:31.691556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dfa5916e-9916-4c31-8e17-59d099a09672 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:31.692372 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dfa5916e-9916-4c31-8e17-59d099a09672 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:31.692812 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dfa5916e-9916-4c31-8e17-59d099a09672 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:31.693284 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dfa5916e-9916-4c31-8e17-59d099a09672 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:31.693702 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-dfa5916e-9916-4c31-8e17-59d099a09672 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:31.697557 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3660f239-7199-4aaa-aec1-1e8cf5d49134 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:31.698050 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3660f239-7199-4aaa-aec1-1e8cf5d49134 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:31.698516 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3660f239-7199-4aaa-aec1-1e8cf5d49134 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:31.699220 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3660f239-7199-4aaa-aec1-1e8cf5d49134 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:31.699669 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3660f239-7199-4aaa-aec1-1e8cf5d49134 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:31.700095 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3660f239-7199-4aaa-aec1-1e8cf5d49134 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:31.897509 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-dfa5916e-9916-4c31-8e17-59d099a09672 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:31.904459 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-3660f239-7199-4aaa-aec1-1e8cf5d49134 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:31.906237 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-dfa5916e-9916-4c31-8e17-59d099a09672 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1265 microversion: 2.1 time: 0.231722 Sep 23 14:09:31.906836 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 405/811] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:31 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:31.914449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-3660f239-7199-4aaa-aec1-1e8cf5d49134 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:31.915872 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-3660f239-7199-4aaa-aec1-1e8cf5d49134 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:31.917105 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-3660f239-7199-4aaa-aec1-1e8cf5d49134 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1717 microversion: 2.20 time: 0.232152 Sep 23 14:09:31.917778 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 407/812] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:09:31 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1717 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:09:32.928854 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5c28dd30-e9e0-4c3a-9543-863b45529317 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:32.929596 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5c28dd30-e9e0-4c3a-9543-863b45529317 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:32.936976 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5c28dd30-e9e0-4c3a-9543-863b45529317 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:32.937627 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5c28dd30-e9e0-4c3a-9543-863b45529317 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:32.938177 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5c28dd30-e9e0-4c3a-9543-863b45529317 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:32.938805 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5c28dd30-e9e0-4c3a-9543-863b45529317 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:32.939262 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5c28dd30-e9e0-4c3a-9543-863b45529317 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:32.939690 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5c28dd30-e9e0-4c3a-9543-863b45529317 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:33.076518 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5c28dd30-e9e0-4c3a-9543-863b45529317 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:33.085090 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5c28dd30-e9e0-4c3a-9543-863b45529317 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1265 microversion: 2.1 time: 0.160294 Sep 23 14:09:33.085663 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 406/813] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:32 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:34.111036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-065f4745-2266-4d58-84dc-416d75f3c687 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:34.111728 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-065f4745-2266-4d58-84dc-416d75f3c687 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:34.113740 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:34.114529 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=8 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:34.115262 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:34.119993 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-065f4745-2266-4d58-84dc-416d75f3c687 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:34.120543 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-065f4745-2266-4d58-84dc-416d75f3c687 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:34.121144 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-065f4745-2266-4d58-84dc-416d75f3c687 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:34.121909 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-065f4745-2266-4d58-84dc-416d75f3c687 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:34.122462 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-065f4745-2266-4d58-84dc-416d75f3c687 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:34.122955 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-065f4745-2266-4d58-84dc-416d75f3c687 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:34.127114 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=100 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:34.256294 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-065f4745-2266-4d58-84dc-416d75f3c687 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:34.263949 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-065f4745-2266-4d58-84dc-416d75f3c687 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1265 microversion: 2.1 time: 0.158826 Sep 23 14:09:34.266057 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 408/814] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:34 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:35.288788 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-272baf5c-7547-4f0d-a9fa-6378e6c2bdb7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:35.289402 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-272baf5c-7547-4f0d-a9fa-6378e6c2bdb7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:35.296507 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-272baf5c-7547-4f0d-a9fa-6378e6c2bdb7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:35.296991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-272baf5c-7547-4f0d-a9fa-6378e6c2bdb7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:35.297427 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-272baf5c-7547-4f0d-a9fa-6378e6c2bdb7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:35.298111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-272baf5c-7547-4f0d-a9fa-6378e6c2bdb7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:35.298672 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-272baf5c-7547-4f0d-a9fa-6378e6c2bdb7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:35.299099 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-272baf5c-7547-4f0d-a9fa-6378e6c2bdb7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:35.431535 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-272baf5c-7547-4f0d-a9fa-6378e6c2bdb7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:35.439633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-272baf5c-7547-4f0d-a9fa-6378e6c2bdb7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1265 microversion: 2.1 time: 0.154999 Sep 23 14:09:35.440195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 407/815] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:35 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:36.462883 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5ae3fcc8-eeee-4318-bc27-1a278885e072 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:36.463497 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-5ae3fcc8-eeee-4318-bc27-1a278885e072 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:36.470747 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5ae3fcc8-eeee-4318-bc27-1a278885e072 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:36.471241 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5ae3fcc8-eeee-4318-bc27-1a278885e072 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:36.471680 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5ae3fcc8-eeee-4318-bc27-1a278885e072 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:36.472378 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5ae3fcc8-eeee-4318-bc27-1a278885e072 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:36.472841 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5ae3fcc8-eeee-4318-bc27-1a278885e072 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:36.473274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5ae3fcc8-eeee-4318-bc27-1a278885e072 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:36.600678 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5ae3fcc8-eeee-4318-bc27-1a278885e072 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:36.608816 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5ae3fcc8-eeee-4318-bc27-1a278885e072 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1265 microversion: 2.1 time: 0.149161 Sep 23 14:09:36.609383 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 409/816] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:36 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:37.631462 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e15e1d1c-1e54-40ac-b9a6-a9895055c1fc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:37.631987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e15e1d1c-1e54-40ac-b9a6-a9895055c1fc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:37.637918 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e15e1d1c-1e54-40ac-b9a6-a9895055c1fc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:37.638429 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e15e1d1c-1e54-40ac-b9a6-a9895055c1fc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:37.638871 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e15e1d1c-1e54-40ac-b9a6-a9895055c1fc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:37.639594 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e15e1d1c-1e54-40ac-b9a6-a9895055c1fc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:37.640043 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e15e1d1c-1e54-40ac-b9a6-a9895055c1fc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:37.640468 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e15e1d1c-1e54-40ac-b9a6-a9895055c1fc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:37.767819 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e15e1d1c-1e54-40ac-b9a6-a9895055c1fc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:37.775443 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e15e1d1c-1e54-40ac-b9a6-a9895055c1fc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1265 microversion: 2.1 time: 0.148398 Sep 23 14:09:37.776012 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 408/817] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:37 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:38.797157 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-767a9a0e-7551-4a21-9214-95d5909804dc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:38.797894 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-767a9a0e-7551-4a21-9214-95d5909804dc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:38.803921 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-767a9a0e-7551-4a21-9214-95d5909804dc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:38.804484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-767a9a0e-7551-4a21-9214-95d5909804dc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:38.805008 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-767a9a0e-7551-4a21-9214-95d5909804dc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:38.805781 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-767a9a0e-7551-4a21-9214-95d5909804dc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:38.806289 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-767a9a0e-7551-4a21-9214-95d5909804dc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:38.806999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-767a9a0e-7551-4a21-9214-95d5909804dc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:38.956078 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-767a9a0e-7551-4a21-9214-95d5909804dc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:38.961905 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-767a9a0e-7551-4a21-9214-95d5909804dc tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1265 microversion: 2.1 time: 0.168749 Sep 23 14:09:38.962538 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 410/818] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:38 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:39.986196 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ed1e5ffa-24f4-4df3-8739-0025ed456e3b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:39.987480 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ed1e5ffa-24f4-4df3-8739-0025ed456e3b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:39.993504 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ed1e5ffa-24f4-4df3-8739-0025ed456e3b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:39.993993 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ed1e5ffa-24f4-4df3-8739-0025ed456e3b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:39.994462 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ed1e5ffa-24f4-4df3-8739-0025ed456e3b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:39.995159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ed1e5ffa-24f4-4df3-8739-0025ed456e3b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:39.995620 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ed1e5ffa-24f4-4df3-8739-0025ed456e3b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:39.996107 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ed1e5ffa-24f4-4df3-8739-0025ed456e3b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:40.137187 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ed1e5ffa-24f4-4df3-8739-0025ed456e3b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:40.141627 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=100 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:40.146554 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ed1e5ffa-24f4-4df3-8739-0025ed456e3b tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1265 microversion: 2.1 time: 0.165824 Sep 23 14:09:40.147127 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 409/819] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:39 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:40.347081 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-dd398916-5b23-42aa-95f1-664e2a8d57b2 req-bbc587a7-803c-443f-bbbb-4e1f7e1343a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a08d7c5-4906-498e-980d-ec6d35ba8bee", "name": "network-vif-plugged", "status": "completed", "tag": "bebfb579-fd1e-4f01-81d1-df4839bfbcc5"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:09:40.356495 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-dd398916-5b23-42aa-95f1-664e2a8d57b2 req-bbc587a7-803c-443f-bbbb-4e1f7e1343a3 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:40.356975 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-dd398916-5b23-42aa-95f1-664e2a8d57b2 req-bbc587a7-803c-443f-bbbb-4e1f7e1343a3 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:40.357407 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-dd398916-5b23-42aa-95f1-664e2a8d57b2 req-bbc587a7-803c-443f-bbbb-4e1f7e1343a3 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:40.368326 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-dd398916-5b23-42aa-95f1-664e2a8d57b2 req-bbc587a7-803c-443f-bbbb-4e1f7e1343a3 service nova] Creating event network-vif-plugged:bebfb579-fd1e-4f01-81d1-df4839bfbcc5 for instance 6a08d7c5-4906-498e-980d-ec6d35ba8bee on hv-cinder-85743 Sep 23 14:09:40.373294 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-dd398916-5b23-42aa-95f1-664e2a8d57b2 req-bbc587a7-803c-443f-bbbb-4e1f7e1343a3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029985 Sep 23 14:09:40.374474 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 411/820] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:09:41.169176 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-257e0482-f4c7-4255-be4b-b599cccb3fbf tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:41.169851 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-257e0482-f4c7-4255-be4b-b599cccb3fbf tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:41.177410 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-257e0482-f4c7-4255-be4b-b599cccb3fbf tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:41.177900 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-257e0482-f4c7-4255-be4b-b599cccb3fbf tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:41.178354 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-257e0482-f4c7-4255-be4b-b599cccb3fbf tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:41.179035 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-257e0482-f4c7-4255-be4b-b599cccb3fbf tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:41.179492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-257e0482-f4c7-4255-be4b-b599cccb3fbf tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:41.179977 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-257e0482-f4c7-4255-be4b-b599cccb3fbf tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:41.311870 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-257e0482-f4c7-4255-be4b-b599cccb3fbf tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:41.319585 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-257e0482-f4c7-4255-be4b-b599cccb3fbf tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1265 microversion: 2.1 time: 0.154333 Sep 23 14:09:41.320133 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 410/821] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:41 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:42.344247 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a054243a-1d74-42b9-a719-1d11560cb8f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:42.344963 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a054243a-1d74-42b9-a719-1d11560cb8f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:42.351270 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a054243a-1d74-42b9-a719-1d11560cb8f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:42.351760 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a054243a-1d74-42b9-a719-1d11560cb8f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:42.352203 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a054243a-1d74-42b9-a719-1d11560cb8f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:42.352906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a054243a-1d74-42b9-a719-1d11560cb8f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:42.353368 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a054243a-1d74-42b9-a719-1d11560cb8f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:42.353794 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a054243a-1d74-42b9-a719-1d11560cb8f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:42.497037 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a054243a-1d74-42b9-a719-1d11560cb8f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:42.505119 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a054243a-1d74-42b9-a719-1d11560cb8f4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1452 microversion: 2.1 time: 0.165610 Sep 23 14:09:42.505711 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 412/822] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:42 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:42.527559 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d6e923c0-93d2-464f-98f3-dfa0ed505e81 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:09:42.528226 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d6e923c0-93d2-464f-98f3-dfa0ed505e81 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:09:42.535361 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d6e923c0-93d2-464f-98f3-dfa0ed505e81 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:42.535854 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d6e923c0-93d2-464f-98f3-dfa0ed505e81 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:42.536355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d6e923c0-93d2-464f-98f3-dfa0ed505e81 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:42.537051 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d6e923c0-93d2-464f-98f3-dfa0ed505e81 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:42.537531 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d6e923c0-93d2-464f-98f3-dfa0ed505e81 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:42.537956 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d6e923c0-93d2-464f-98f3-dfa0ed505e81 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:42.669202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d6e923c0-93d2-464f-98f3-dfa0ed505e81 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:09:42.678138 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d6e923c0-93d2-464f-98f3-dfa0ed505e81 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1452 microversion: 2.1 time: 0.154220 Sep 23 14:09:42.678597 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 411/823] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:09:42 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:09:44.973073 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-b55f73bb-3024-4f3e-9934-19b3fcaba42f req-a7798f2c-02cb-4933-b614-29d83568bb44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a08d7c5-4906-498e-980d-ec6d35ba8bee", "tag": "bebfb579-fd1e-4f01-81d1-df4839bfbcc5"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:09:44.989878 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-b55f73bb-3024-4f3e-9934-19b3fcaba42f req-a7798f2c-02cb-4933-b614-29d83568bb44 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:09:44.992831 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-b55f73bb-3024-4f3e-9934-19b3fcaba42f req-a7798f2c-02cb-4933-b614-29d83568bb44 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:09:44.995882 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-b55f73bb-3024-4f3e-9934-19b3fcaba42f req-a7798f2c-02cb-4933-b614-29d83568bb44 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:09:45.009050 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-b55f73bb-3024-4f3e-9934-19b3fcaba42f req-a7798f2c-02cb-4933-b614-29d83568bb44 service nova] Creating event network-changed:bebfb579-fd1e-4f01-81d1-df4839bfbcc5 for instance 6a08d7c5-4906-498e-980d-ec6d35ba8bee on hv-cinder-85743 Sep 23 14:09:45.014430 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-b55f73bb-3024-4f3e-9934-19b3fcaba42f req-a7798f2c-02cb-4933-b614-29d83568bb44 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047143 Sep 23 14:09:45.016260 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 413/824] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:10:04.448536 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1605087227", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "networks": [{"uuid": "7d566560-6d05-4813-af89-28dc8e1f05bf"}]}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:04.453620 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=13 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:04.454318 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=12 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:04.500667 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.network.neutron [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] validate_networks() for [('7d566560-6d05-4813-af89-28dc8e1f05bf', None, None, None, None, None)] {{(pid=121073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:10:04.850027 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Flavor limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:10:04.850485 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Image limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:10:04.850969 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Flavor pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:10:04.851380 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Image pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:10:04.851795 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:10:04.860635 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:04.861174 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:04.861814 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:04.862391 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:04.862849 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:04.863274 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:04.880688 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Getting quotas for project c4ce494070ca4b76a93a6a4a9f42414c. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:10:04.884731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Getting quotas for user 256d2963df4c4e48876583485de59674 and project c4ce494070ca4b76a93a6a4a9f42414c. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:10:04.896291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Going to run 1 instances... {{(pid=121073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:10:04.900663 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:10:05.058474 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-71a5b6ce-4a43-4b23-8ce1-2457eb8e40be tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617882 Sep 23 14:10:05.059045 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 412/825] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:10:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 14:10:05.067788 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=11 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:05.068528 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=27 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:05.073717 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-02604019-7885-4e2b-b140-640b9e909adb tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:05.075015 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-02604019-7885-4e2b-b140-640b9e909adb tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:05.128040 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-02604019-7885-4e2b-b140-640b9e909adb tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:05.135127 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-02604019-7885-4e2b-b140-640b9e909adb tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1214 microversion: 2.1 time: 0.068438 Sep 23 14:10:05.135700 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 414/826] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:05 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:06.159249 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-bc65becf-4fcf-4738-a29f-722cc3d6677c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:06.159998 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-bc65becf-4fcf-4738-a29f-722cc3d6677c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:06.166697 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bc65becf-4fcf-4738-a29f-722cc3d6677c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:06.169815 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bc65becf-4fcf-4738-a29f-722cc3d6677c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:06.169815 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bc65becf-4fcf-4738-a29f-722cc3d6677c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:06.169815 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bc65becf-4fcf-4738-a29f-722cc3d6677c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:06.169815 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bc65becf-4fcf-4738-a29f-722cc3d6677c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:06.170189 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bc65becf-4fcf-4738-a29f-722cc3d6677c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:06.230288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-bc65becf-4fcf-4738-a29f-722cc3d6677c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:06.238605 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-bc65becf-4fcf-4738-a29f-722cc3d6677c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1218 microversion: 2.1 time: 0.084112 Sep 23 14:10:06.239186 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 413/827] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:06 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:07.261178 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b16bc05c-8eee-4c17-b6b5-ba9239f71a2f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:07.261756 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b16bc05c-8eee-4c17-b6b5-ba9239f71a2f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:07.269321 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b16bc05c-8eee-4c17-b6b5-ba9239f71a2f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:07.269815 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b16bc05c-8eee-4c17-b6b5-ba9239f71a2f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:07.270252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b16bc05c-8eee-4c17-b6b5-ba9239f71a2f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:07.270961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b16bc05c-8eee-4c17-b6b5-ba9239f71a2f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:07.271419 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b16bc05c-8eee-4c17-b6b5-ba9239f71a2f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:07.271881 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b16bc05c-8eee-4c17-b6b5-ba9239f71a2f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:07.335633 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b16bc05c-8eee-4c17-b6b5-ba9239f71a2f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:07.343272 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b16bc05c-8eee-4c17-b6b5-ba9239f71a2f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1266 microversion: 2.1 time: 0.086048 Sep 23 14:10:07.343833 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 415/828] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:07 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:08.366064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1d7ac154-22c3-4d0d-b8b9-b7708a175856 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:08.366768 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1d7ac154-22c3-4d0d-b8b9-b7708a175856 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:08.373316 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d7ac154-22c3-4d0d-b8b9-b7708a175856 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:08.373805 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d7ac154-22c3-4d0d-b8b9-b7708a175856 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:08.374242 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d7ac154-22c3-4d0d-b8b9-b7708a175856 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:08.375088 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d7ac154-22c3-4d0d-b8b9-b7708a175856 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:08.375649 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d7ac154-22c3-4d0d-b8b9-b7708a175856 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:08.376115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1d7ac154-22c3-4d0d-b8b9-b7708a175856 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:08.621264 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1d7ac154-22c3-4d0d-b8b9-b7708a175856 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:08.630387 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1d7ac154-22c3-4d0d-b8b9-b7708a175856 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1314 microversion: 2.1 time: 0.268365 Sep 23 14:10:08.631445 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 414/829] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:08 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:09.227364 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-e3c40f12-0695-4e01-882b-c7280808c740 req-2d74af65-448a-4235-b381-4a0610ce869b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c937b4-c14c-4761-83ff-cf16703c0818", "tag": "8a2f6a36-e9df-41f2-ae66-3fad8840d659"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:09.239541 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-e3c40f12-0695-4e01-882b-c7280808c740 req-2d74af65-448a-4235-b381-4a0610ce869b service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:09.240086 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-e3c40f12-0695-4e01-882b-c7280808c740 req-2d74af65-448a-4235-b381-4a0610ce869b service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:09.240545 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-e3c40f12-0695-4e01-882b-c7280808c740 req-2d74af65-448a-4235-b381-4a0610ce869b service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:09.252265 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-e3c40f12-0695-4e01-882b-c7280808c740 req-2d74af65-448a-4235-b381-4a0610ce869b service nova] Creating event network-changed:8a2f6a36-e9df-41f2-ae66-3fad8840d659 for instance e9c937b4-c14c-4761-83ff-cf16703c0818 on hv-cinder-85743 Sep 23 14:10:09.257931 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-e3c40f12-0695-4e01-882b-c7280808c740 req-2d74af65-448a-4235-b381-4a0610ce869b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034297 Sep 23 14:10:09.260689 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 416/830] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:10:09.655211 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1900bd9c-1a6d-4cba-a80c-95f088376923 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:09.656063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1900bd9c-1a6d-4cba-a80c-95f088376923 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:09.666595 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1900bd9c-1a6d-4cba-a80c-95f088376923 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:09.667571 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1900bd9c-1a6d-4cba-a80c-95f088376923 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:09.668026 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1900bd9c-1a6d-4cba-a80c-95f088376923 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:09.668791 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1900bd9c-1a6d-4cba-a80c-95f088376923 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:09.670267 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1900bd9c-1a6d-4cba-a80c-95f088376923 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:09.670735 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1900bd9c-1a6d-4cba-a80c-95f088376923 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:10.082720 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1900bd9c-1a6d-4cba-a80c-95f088376923 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:10.090890 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1900bd9c-1a6d-4cba-a80c-95f088376923 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1314 microversion: 2.1 time: 0.439385 Sep 23 14:10:10.091483 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 415/831] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:09 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:10.401030 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6ea6759e-d4bf-4eef-a660-6650da793d48 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:10.403311 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6ea6759e-d4bf-4eef-a660-6650da793d48 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:10.409600 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6ea6759e-d4bf-4eef-a660-6650da793d48 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:10.410203 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6ea6759e-d4bf-4eef-a660-6650da793d48 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:10.410672 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6ea6759e-d4bf-4eef-a660-6650da793d48 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:10.411376 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6ea6759e-d4bf-4eef-a660-6650da793d48 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:10.411837 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6ea6759e-d4bf-4eef-a660-6650da793d48 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:10.412276 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6ea6759e-d4bf-4eef-a660-6650da793d48 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:10.443499 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6ea6759e-d4bf-4eef-a660-6650da793d48 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046827 Sep 23 14:10:10.444068 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 417/832] 10.222.0.62 () {60 vars in 1343 bytes} [Fri Sep 23 14:10:10 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:10.510694 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-bdb135df-a3f2-4b62-aa4e-c94087314a9a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:10.511314 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-bdb135df-a3f2-4b62-aa4e-c94087314a9a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:10.517255 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bdb135df-a3f2-4b62-aa4e-c94087314a9a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:10.525930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bdb135df-a3f2-4b62-aa4e-c94087314a9a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:10.525930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bdb135df-a3f2-4b62-aa4e-c94087314a9a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:10.525930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bdb135df-a3f2-4b62-aa4e-c94087314a9a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:10.525930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bdb135df-a3f2-4b62-aa4e-c94087314a9a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:10.526298 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bdb135df-a3f2-4b62-aa4e-c94087314a9a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:10.550527 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-bdb135df-a3f2-4b62-aa4e-c94087314a9a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Going to try to terminate instance {{(pid=121073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:10:10.895477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-bdb135df-a3f2-4b62-aa4e-c94087314a9a tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 204 len: 0 microversion: 2.20 time: 0.388191 Sep 23 14:10:10.896234 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 416/833] 10.222.0.62 () {60 vars in 1280 bytes} [Fri Sep 23 14:10:10 2022] DELETE /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 14:10:10.904877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9bf19483-e3be-4998-a8c7-32e6a1a02bed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:10.905488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-9bf19483-e3be-4998-a8c7-32e6a1a02bed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:10.912128 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9bf19483-e3be-4998-a8c7-32e6a1a02bed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:10.912614 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9bf19483-e3be-4998-a8c7-32e6a1a02bed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:10.913050 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9bf19483-e3be-4998-a8c7-32e6a1a02bed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:10.913738 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9bf19483-e3be-4998-a8c7-32e6a1a02bed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:10.914192 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9bf19483-e3be-4998-a8c7-32e6a1a02bed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:10.914657 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9bf19483-e3be-4998-a8c7-32e6a1a02bed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:11.059965 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9bf19483-e3be-4998-a8c7-32e6a1a02bed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:11.069354 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9bf19483-e3be-4998-a8c7-32e6a1a02bed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:11.070951 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-9bf19483-e3be-4998-a8c7-32e6a1a02bed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:11.072371 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-9bf19483-e3be-4998-a8c7-32e6a1a02bed tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1723 microversion: 2.20 time: 0.171371 Sep 23 14:10:11.072930 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 418/834] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:10:10 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 14:10:11.117892 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-62b6db06-bf2f-4911-bc8c-228662ec0d19 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:11.118776 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-62b6db06-bf2f-4911-bc8c-228662ec0d19 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:11.124758 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-62b6db06-bf2f-4911-bc8c-228662ec0d19 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:11.125343 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-62b6db06-bf2f-4911-bc8c-228662ec0d19 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:11.125867 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-62b6db06-bf2f-4911-bc8c-228662ec0d19 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:11.126652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-62b6db06-bf2f-4911-bc8c-228662ec0d19 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:11.127186 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-62b6db06-bf2f-4911-bc8c-228662ec0d19 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:11.127661 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-62b6db06-bf2f-4911-bc8c-228662ec0d19 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:11.263472 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-62b6db06-bf2f-4911-bc8c-228662ec0d19 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:11.271135 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-62b6db06-bf2f-4911-bc8c-228662ec0d19 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1314 microversion: 2.1 time: 0.157374 Sep 23 14:10:11.271687 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 417/835] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:11 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:12.098522 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fabd3f12-98dd-4acc-add5-8cc2e2d9e744 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:12.099137 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-fabd3f12-98dd-4acc-add5-8cc2e2d9e744 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:12.105163 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fabd3f12-98dd-4acc-add5-8cc2e2d9e744 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:12.105653 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fabd3f12-98dd-4acc-add5-8cc2e2d9e744 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:12.106093 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fabd3f12-98dd-4acc-add5-8cc2e2d9e744 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:12.106826 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fabd3f12-98dd-4acc-add5-8cc2e2d9e744 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:12.107277 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fabd3f12-98dd-4acc-add5-8cc2e2d9e744 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:12.107700 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fabd3f12-98dd-4acc-add5-8cc2e2d9e744 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:12.241904 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fabd3f12-98dd-4acc-add5-8cc2e2d9e744 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:12.250730 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fabd3f12-98dd-4acc-add5-8cc2e2d9e744 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:12.252102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fabd3f12-98dd-4acc-add5-8cc2e2d9e744 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:12.253495 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fabd3f12-98dd-4acc-add5-8cc2e2d9e744 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1723 microversion: 2.20 time: 0.159409 Sep 23 14:10:12.254038 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 419/836] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:10:12 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:10:12.292938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-df62042e-b197-40d1-b85f-77c766c47f6b tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:12.293549 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-df62042e-b197-40d1-b85f-77c766c47f6b tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:12.300095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-df62042e-b197-40d1-b85f-77c766c47f6b tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:12.300576 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-df62042e-b197-40d1-b85f-77c766c47f6b tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:12.301008 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-df62042e-b197-40d1-b85f-77c766c47f6b tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:12.304793 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-df62042e-b197-40d1-b85f-77c766c47f6b tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:12.304793 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-df62042e-b197-40d1-b85f-77c766c47f6b tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:12.304793 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-df62042e-b197-40d1-b85f-77c766c47f6b tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:12.445586 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-df62042e-b197-40d1-b85f-77c766c47f6b tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:12.453134 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-df62042e-b197-40d1-b85f-77c766c47f6b tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1314 microversion: 2.1 time: 0.164017 Sep 23 14:10:12.453765 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 418/837] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:12 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:13.279788 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b97e67c6-bbe0-47fc-8f0b-0994044385ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:13.280331 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b97e67c6-bbe0-47fc-8f0b-0994044385ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:13.287087 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b97e67c6-bbe0-47fc-8f0b-0994044385ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:13.287575 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b97e67c6-bbe0-47fc-8f0b-0994044385ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:13.288013 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b97e67c6-bbe0-47fc-8f0b-0994044385ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:13.288705 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b97e67c6-bbe0-47fc-8f0b-0994044385ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:13.289158 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b97e67c6-bbe0-47fc-8f0b-0994044385ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:13.289583 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b97e67c6-bbe0-47fc-8f0b-0994044385ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:13.477987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a0511ed2-1b96-41cb-b40b-f2c6c8488187 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:13.478746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a0511ed2-1b96-41cb-b40b-f2c6c8488187 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:13.485141 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0511ed2-1b96-41cb-b40b-f2c6c8488187 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:13.485739 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0511ed2-1b96-41cb-b40b-f2c6c8488187 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:13.486246 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0511ed2-1b96-41cb-b40b-f2c6c8488187 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:13.487048 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0511ed2-1b96-41cb-b40b-f2c6c8488187 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:13.488317 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0511ed2-1b96-41cb-b40b-f2c6c8488187 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:13.488775 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0511ed2-1b96-41cb-b40b-f2c6c8488187 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:13.518381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b97e67c6-bbe0-47fc-8f0b-0994044385ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:13.526570 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b97e67c6-bbe0-47fc-8f0b-0994044385ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:13.528042 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b97e67c6-bbe0-47fc-8f0b-0994044385ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:13.529197 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b97e67c6-bbe0-47fc-8f0b-0994044385ee tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1723 microversion: 2.20 time: 0.253386 Sep 23 14:10:13.529759 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 420/838] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:10:13 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:10:13.713503 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a0511ed2-1b96-41cb-b40b-f2c6c8488187 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:13.721302 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a0511ed2-1b96-41cb-b40b-f2c6c8488187 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1314 microversion: 2.1 time: 0.247205 Sep 23 14:10:13.722795 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 419/839] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:13 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:10:14.376784 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-8bb859ae-47b0-4115-8719-3f46d8d91e6d req-13b7e64e-1d19-4d23-94a8-fee8cf060478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49eff20-f8a6-404b-b09c-def6e4c167ca", "name": "network-vif-deleted", "tag": "20043706-94ae-416a-96d1-e1f2fc14183b"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:14.385755 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-8bb859ae-47b0-4115-8719-3f46d8d91e6d req-13b7e64e-1d19-4d23-94a8-fee8cf060478 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:14.386293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-8bb859ae-47b0-4115-8719-3f46d8d91e6d req-13b7e64e-1d19-4d23-94a8-fee8cf060478 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:14.387281 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-8bb859ae-47b0-4115-8719-3f46d8d91e6d req-13b7e64e-1d19-4d23-94a8-fee8cf060478 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:14.399728 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-8bb859ae-47b0-4115-8719-3f46d8d91e6d req-13b7e64e-1d19-4d23-94a8-fee8cf060478 service nova] Creating event network-vif-deleted:20043706-94ae-416a-96d1-e1f2fc14183b for instance c49eff20-f8a6-404b-b09c-def6e4c167ca on hv-cinder-85743 Sep 23 14:10:14.407962 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-8bb859ae-47b0-4115-8719-3f46d8d91e6d req-13b7e64e-1d19-4d23-94a8-fee8cf060478 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033947 Sep 23 14:10:14.407962 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 421/840] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:10:14.557151 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-20ff9c79-691e-4a15-92bb-77fb835f0af6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:14.557872 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-20ff9c79-691e-4a15-92bb-77fb835f0af6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:14.566433 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20ff9c79-691e-4a15-92bb-77fb835f0af6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:14.567215 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20ff9c79-691e-4a15-92bb-77fb835f0af6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:14.567884 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20ff9c79-691e-4a15-92bb-77fb835f0af6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:14.568860 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20ff9c79-691e-4a15-92bb-77fb835f0af6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:14.569886 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20ff9c79-691e-4a15-92bb-77fb835f0af6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:14.570606 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-20ff9c79-691e-4a15-92bb-77fb835f0af6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:14.679503 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-20ff9c79-691e-4a15-92bb-77fb835f0af6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:14.689356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-20ff9c79-691e-4a15-92bb-77fb835f0af6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:14.695063 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-67abd97e-9c18-4065-9f98-35a3caaff6ed req-b3e7b845-ca7e-42a6-9a89-f2dabe148213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c937b4-c14c-4761-83ff-cf16703c0818", "name": "network-vif-plugged", "status": "completed", "tag": "8a2f6a36-e9df-41f2-ae66-3fad8840d659"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:14.704745 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-20ff9c79-691e-4a15-92bb-77fb835f0af6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777c43fe5c142b3b5ea5e2485f4e49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21d140d48ba4014bc470e8cf720785d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:14.707053 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-20ff9c79-691e-4a15-92bb-77fb835f0af6 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 200 len: 1365 microversion: 2.20 time: 0.154411 Sep 23 14:10:14.707717 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 420/841] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:10:14 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 14:10:14.712267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-67abd97e-9c18-4065-9f98-35a3caaff6ed req-b3e7b845-ca7e-42a6-9a89-f2dabe148213 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:14.712992 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-67abd97e-9c18-4065-9f98-35a3caaff6ed req-b3e7b845-ca7e-42a6-9a89-f2dabe148213 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:14.713373 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-67abd97e-9c18-4065-9f98-35a3caaff6ed req-b3e7b845-ca7e-42a6-9a89-f2dabe148213 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:14.724566 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-67abd97e-9c18-4065-9f98-35a3caaff6ed req-b3e7b845-ca7e-42a6-9a89-f2dabe148213 service nova] Creating event network-vif-plugged:8a2f6a36-e9df-41f2-ae66-3fad8840d659 for instance e9c937b4-c14c-4761-83ff-cf16703c0818 on hv-cinder-85743 Sep 23 14:10:14.730791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-67abd97e-9c18-4065-9f98-35a3caaff6ed req-b3e7b845-ca7e-42a6-9a89-f2dabe148213 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044156 Sep 23 14:10:14.735616 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 422/842] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:10:14.746033 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-316939d9-76ad-46e8-b664-52eecfe19b0a tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:14.746700 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-316939d9-76ad-46e8-b664-52eecfe19b0a tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:14.753611 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-316939d9-76ad-46e8-b664-52eecfe19b0a tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:14.753861 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-316939d9-76ad-46e8-b664-52eecfe19b0a tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:14.754302 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-316939d9-76ad-46e8-b664-52eecfe19b0a tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:14.755031 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-316939d9-76ad-46e8-b664-52eecfe19b0a tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:14.755496 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-316939d9-76ad-46e8-b664-52eecfe19b0a tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:14.755924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-316939d9-76ad-46e8-b664-52eecfe19b0a tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:14.871124 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:14.894667 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=6 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:14.941404 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-316939d9-76ad-46e8-b664-52eecfe19b0a tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:14.949680 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-316939d9-76ad-46e8-b664-52eecfe19b0a tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1314 microversion: 2.1 time: 0.207587 Sep 23 14:10:14.950355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 421/843] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:14 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:15.729413 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:15.733635 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1ba2d349-0e61-4fea-8009-387c5f37003f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:15.734346 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1ba2d349-0e61-4fea-8009-387c5f37003f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:15.741156 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1ba2d349-0e61-4fea-8009-387c5f37003f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:15.741641 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1ba2d349-0e61-4fea-8009-387c5f37003f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:15.742077 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1ba2d349-0e61-4fea-8009-387c5f37003f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:15.742795 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1ba2d349-0e61-4fea-8009-387c5f37003f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:15.743337 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1ba2d349-0e61-4fea-8009-387c5f37003f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:15.743767 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1ba2d349-0e61-4fea-8009-387c5f37003f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:15.757707 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-1ba2d349-0e61-4fea-8009-387c5f37003f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] HTTP exception thrown: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1ba2d349-0e61-4fea-8009-387c5f37003f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Request method failure captured: Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca HTTP/1.1 Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbzD5tcLB7ojLK9sr1C8_DBx43QfyeN7NeFu7YWTgc9cqtaWAuzwgcRnelGs9UVBOqmlLHHFjXsUUof6q-DBOazO4tZAPYT1KymIaJYtWPTehkSBtOvXp-5qmhIOecgRwOuGBsgkkh_mpkl_QdwgDodLMUSm2yeDbcRFg4GTEvC_IxQ Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: c21d140d48ba4014bc470e8cf720785d Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:10:15.763758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:10:15.765458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c21d140d48ba4014bc470e8cf720785d"}]}] Sep 23 14:10:15.765458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:15.765458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: c21d140d48ba4014bc470e8cf720785d Sep 23 14:10:15.765458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:15.765458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-AttachVolumeShelveTestJSON-1453461522-project Sep 23 14:10:15.765458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:10:15.765458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:10:15.765458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: d777c43fe5c142b3b5ea5e2485f4e49f Sep 23 14:10:15.765458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1453461522-project Sep 23 14:10:15.765458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:10:15.765458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:15.765458 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': 'c49eff20-f8a6-404b-b09c-def6e4c167ca'} Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:10:15.766513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:15.768010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:15.769380 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1ba2d349-0e61-4fea-8009-387c5f37003f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Returning 404 to user: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:10:15.769380 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1ba2d349-0e61-4fea-8009-387c5f37003f tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 404 len: 111 microversion: 2.20 time: 0.032490 Sep 23 14:10:15.769380 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 423/844] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:10:15 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 14:10:15.774695 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-71fc82fb-14ef-4ad4-87ef-b7e76457518b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '.version_select at 0x7f9083a82310>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:15.955095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-71fc82fb-14ef-4ad4-87ef-b7e76457518b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67753299" status: 204 len: 0 microversion: 2.20 time: 0.184139 Sep 23 14:10:15.955677 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 422/845] 10.222.0.62 () {60 vars in 1256 bytes} [Fri Sep 23 14:10:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67753299 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 14:10:15.972880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d74c9a2d-373d-4c87-8660-b7bab301a13d tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:15.973532 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d74c9a2d-373d-4c87-8660-b7bab301a13d tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:15.980554 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d74c9a2d-373d-4c87-8660-b7bab301a13d tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:15.981047 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d74c9a2d-373d-4c87-8660-b7bab301a13d tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:15.981569 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d74c9a2d-373d-4c87-8660-b7bab301a13d tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:15.982282 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d74c9a2d-373d-4c87-8660-b7bab301a13d tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:15.982767 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d74c9a2d-373d-4c87-8660-b7bab301a13d tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:15.983196 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d74c9a2d-373d-4c87-8660-b7bab301a13d tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:16.134310 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d74c9a2d-373d-4c87-8660-b7bab301a13d tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:16.142475 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d74c9a2d-373d-4c87-8660-b7bab301a13d tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1314 microversion: 2.1 time: 0.173340 Sep 23 14:10:16.143456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 424/846] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:15 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:17.166414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-aa04b094-cade-4000-9b49-f9703b997695 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:17.167084 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-aa04b094-cade-4000-9b49-f9703b997695 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:17.175995 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aa04b094-cade-4000-9b49-f9703b997695 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:17.176481 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aa04b094-cade-4000-9b49-f9703b997695 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:17.177341 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aa04b094-cade-4000-9b49-f9703b997695 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:17.178054 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aa04b094-cade-4000-9b49-f9703b997695 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:17.178544 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aa04b094-cade-4000-9b49-f9703b997695 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:17.178973 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-aa04b094-cade-4000-9b49-f9703b997695 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:17.312719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-aa04b094-cade-4000-9b49-f9703b997695 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:17.321488 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-aa04b094-cade-4000-9b49-f9703b997695 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1498 microversion: 2.1 time: 0.159002 Sep 23 14:10:17.322059 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 423/847] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:17 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:18.235940 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-781a9a0d-b0b8-4555-859f-d91e574b4d0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:18.236476 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-781a9a0d-b0b8-4555-859f-d91e574b4d0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:18.243222 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-781a9a0d-b0b8-4555-859f-d91e574b4d0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:18.243788 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-781a9a0d-b0b8-4555-859f-d91e574b4d0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:18.244118 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-781a9a0d-b0b8-4555-859f-d91e574b4d0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:18.244816 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-781a9a0d-b0b8-4555-859f-d91e574b4d0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:18.245277 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-781a9a0d-b0b8-4555-859f-d91e574b4d0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:18.245707 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-781a9a0d-b0b8-4555-859f-d91e574b4d0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:18.261110 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-781a9a0d-b0b8-4555-859f-d91e574b4d0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] HTTP exception thrown: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-781a9a0d-b0b8-4555-859f-d91e574b4d0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Request method failure captured: Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: DELETE /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca HTTP/1.1 Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbzD5tcLB7ojLK9sr1C8_DBx43QfyeN7NeFu7YWTgc9cqtaWAuzwgcRnelGs9UVBOqmlLHHFjXsUUof6q-DBOazO4tZAPYT1KymIaJYtWPTehkSBtOvXp-5qmhIOecgRwOuGBsgkkh_mpkl_QdwgDodLMUSm2yeDbcRFg4GTEvC_IxQ Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: c21d140d48ba4014bc470e8cf720785d Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:10:18.262684 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:10:18.264255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c21d140d48ba4014bc470e8cf720785d"}]}] Sep 23 14:10:18.264255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:18.264255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: c21d140d48ba4014bc470e8cf720785d Sep 23 14:10:18.264255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:18.264255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-AttachVolumeShelveTestJSON-1453461522-project Sep 23 14:10:18.264255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:10:18.264255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:10:18.264255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: d777c43fe5c142b3b5ea5e2485f4e49f Sep 23 14:10:18.264255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1453461522-project Sep 23 14:10:18.264255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:10:18.264255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:18.264255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': 'c49eff20-f8a6-404b-b09c-def6e4c167ca'} Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:10:18.265170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:18.266745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:18.268316 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-781a9a0d-b0b8-4555-859f-d91e574b4d0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Returning 404 to user: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:10:18.268316 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-781a9a0d-b0b8-4555-859f-d91e574b4d0b tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 404 len: 111 microversion: 2.20 time: 0.032197 Sep 23 14:10:18.268316 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 425/848] 10.222.0.62 () {60 vars in 1280 bytes} [Fri Sep 23 14:10:18 2022] DELETE /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 23 14:10:18.274166 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ba2d2983-76b9-4fb9-a90e-190dce3bf867 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:18.274976 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ba2d2983-76b9-4fb9-a90e-190dce3bf867 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: c49eff20-f8a6-404b-b09c-def6e4c167ca] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:18.281927 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ba2d2983-76b9-4fb9-a90e-190dce3bf867 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:18.282429 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ba2d2983-76b9-4fb9-a90e-190dce3bf867 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:18.286754 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ba2d2983-76b9-4fb9-a90e-190dce3bf867 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:18.286754 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ba2d2983-76b9-4fb9-a90e-190dce3bf867 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:18.286754 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ba2d2983-76b9-4fb9-a90e-190dce3bf867 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:18.286754 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ba2d2983-76b9-4fb9-a90e-190dce3bf867 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:18.298516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-ba2d2983-76b9-4fb9-a90e-190dce3bf867 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] HTTP exception thrown: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ba2d2983-76b9-4fb9-a90e-190dce3bf867 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Request method failure captured: Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca HTTP/1.1 Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbzD5tcLB7ojLK9sr1C8_DBx43QfyeN7NeFu7YWTgc9cqtaWAuzwgcRnelGs9UVBOqmlLHHFjXsUUof6q-DBOazO4tZAPYT1KymIaJYtWPTehkSBtOvXp-5qmhIOecgRwOuGBsgkkh_mpkl_QdwgDodLMUSm2yeDbcRFg4GTEvC_IxQ Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: c21d140d48ba4014bc470e8cf720785d Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:10:18.300153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:10:18.302375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c21d140d48ba4014bc470e8cf720785d"}]}] Sep 23 14:10:18.302375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:18.302375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: c21d140d48ba4014bc470e8cf720785d Sep 23 14:10:18.302375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:18.302375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-AttachVolumeShelveTestJSON-1453461522-project Sep 23 14:10:18.302375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:10:18.302375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:10:18.302375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: d777c43fe5c142b3b5ea5e2485f4e49f Sep 23 14:10:18.302375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1453461522-project Sep 23 14:10:18.302375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:10:18.302375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:18.302375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': 'c49eff20-f8a6-404b-b09c-def6e4c167ca'} Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:10:18.303502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. Sep 23 14:10:18.304987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:10:18.306772 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ba2d2983-76b9-4fb9-a90e-190dce3bf867 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Returning 404 to user: Instance c49eff20-f8a6-404b-b09c-def6e4c167ca could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:10:18.306772 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ba2d2983-76b9-4fb9-a90e-190dce3bf867 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca" status: 404 len: 111 microversion: 2.20 time: 0.032252 Sep 23 14:10:18.306772 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 424/849] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:10:18 2022] GET /compute/v2.1/servers/c49eff20-f8a6-404b-b09c-def6e4c167ca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 14:10:18.545189 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d46a86de-9058-4eb8-bb17-3fcf53027f93 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:18.545683 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d46a86de-9058-4eb8-bb17-3fcf53027f93 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:18.551638 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d46a86de-9058-4eb8-bb17-3fcf53027f93 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:18.552687 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d46a86de-9058-4eb8-bb17-3fcf53027f93 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:18.553228 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d46a86de-9058-4eb8-bb17-3fcf53027f93 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:18.553920 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d46a86de-9058-4eb8-bb17-3fcf53027f93 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:18.554419 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d46a86de-9058-4eb8-bb17-3fcf53027f93 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:18.554851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d46a86de-9058-4eb8-bb17-3fcf53027f93 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:18.580283 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d46a86de-9058-4eb8-bb17-3fcf53027f93 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Going to try to terminate instance {{(pid=121074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:10:18.885335 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d46a86de-9058-4eb8-bb17-3fcf53027f93 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 204 len: 0 microversion: 2.1 time: 0.343644 Sep 23 14:10:18.885829 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 426/850] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:10:18 2022] DELETE /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:10:18.894051 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9d2dc5be-d5b5-4b33-b38a-004d4bdca4cc tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:18.894692 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9d2dc5be-d5b5-4b33-b38a-004d4bdca4cc tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:18.900801 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d2dc5be-d5b5-4b33-b38a-004d4bdca4cc tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:18.901282 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d2dc5be-d5b5-4b33-b38a-004d4bdca4cc tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:18.901715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d2dc5be-d5b5-4b33-b38a-004d4bdca4cc tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:18.902428 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d2dc5be-d5b5-4b33-b38a-004d4bdca4cc tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:18.902890 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d2dc5be-d5b5-4b33-b38a-004d4bdca4cc tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:18.903312 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9d2dc5be-d5b5-4b33-b38a-004d4bdca4cc tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:19.034613 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9d2dc5be-d5b5-4b33-b38a-004d4bdca4cc tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:19.043073 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9d2dc5be-d5b5-4b33-b38a-004d4bdca4cc tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1504 microversion: 2.1 time: 0.152905 Sep 23 14:10:19.043632 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 425/851] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:18 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:19.565737 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4ab5508f-e543-434c-b8b0-5e96d6df5059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:19.566372 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4ab5508f-e543-434c-b8b0-5e96d6df5059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:19.572166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4ab5508f-e543-434c-b8b0-5e96d6df5059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:19.572652 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4ab5508f-e543-434c-b8b0-5e96d6df5059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:19.573085 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4ab5508f-e543-434c-b8b0-5e96d6df5059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:19.573755 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4ab5508f-e543-434c-b8b0-5e96d6df5059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:19.574203 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4ab5508f-e543-434c-b8b0-5e96d6df5059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:19.574653 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4ab5508f-e543-434c-b8b0-5e96d6df5059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:19.588248 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-4ab5508f-e543-434c-b8b0-5e96d6df5059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] HTTP exception thrown: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4ab5508f-e543-434c-b8b0-5e96d6df5059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Request method failure captured: Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: DELETE /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 HTTP/1.1 Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbzD5tcLB7ojLK9sr1C8_DBx43QfyeN7NeFu7YWTgc9cqtaWAuzwgcRnelGs9UVBOqmlLHHFjXsUUof6q-DBOazO4tZAPYT1KymIaJYtWPTehkSBtOvXp-5qmhIOecgRwOuGBsgkkh_mpkl_QdwgDodLMUSm2yeDbcRFg4GTEvC_IxQ Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: c21d140d48ba4014bc470e8cf720785d Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:10:19.589840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:10:19.591479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c21d140d48ba4014bc470e8cf720785d"}]}] Sep 23 14:10:19.591479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:19.591479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: c21d140d48ba4014bc470e8cf720785d Sep 23 14:10:19.591479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:19.591479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-AttachVolumeShelveTestJSON-1453461522-project Sep 23 14:10:19.591479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:10:19.591479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:10:19.591479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: d777c43fe5c142b3b5ea5e2485f4e49f Sep 23 14:10:19.591479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1453461522-project Sep 23 14:10:19.591479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:10:19.591479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:10:19.591479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': '97557fbe-c1f4-464e-93b8-3c71fbc48936'} Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:10:19.592267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:10:19.593470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:19.594670 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4ab5508f-e543-434c-b8b0-5e96d6df5059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Returning 404 to user: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:10:19.594670 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4ab5508f-e543-434c-b8b0-5e96d6df5059 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "DELETE /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 404 len: 111 microversion: 2.20 time: 0.029712 Sep 23 14:10:19.594670 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 427/852] 10.222.0.62 () {60 vars in 1280 bytes} [Fri Sep 23 14:10:19 2022] DELETE /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 14:10:19.599833 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-456197f8-de72-4117-a564-d42ae0b7dd51 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:19.600444 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-456197f8-de72-4117-a564-d42ae0b7dd51 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] [instance: 97557fbe-c1f4-464e-93b8-3c71fbc48936] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:19.607588 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-456197f8-de72-4117-a564-d42ae0b7dd51 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:19.608094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-456197f8-de72-4117-a564-d42ae0b7dd51 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:19.608529 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-456197f8-de72-4117-a564-d42ae0b7dd51 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:19.609213 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-456197f8-de72-4117-a564-d42ae0b7dd51 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:19.609665 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-456197f8-de72-4117-a564-d42ae0b7dd51 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:19.610083 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-456197f8-de72-4117-a564-d42ae0b7dd51 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:19.624058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-456197f8-de72-4117-a564-d42ae0b7dd51 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] HTTP exception thrown: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-456197f8-de72-4117-a564-d42ae0b7dd51 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Request method failure captured: Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 HTTP/1.1 Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbzD5tcLB7ojLK9sr1C8_DBx43QfyeN7NeFu7YWTgc9cqtaWAuzwgcRnelGs9UVBOqmlLHHFjXsUUof6q-DBOazO4tZAPYT1KymIaJYtWPTehkSBtOvXp-5qmhIOecgRwOuGBsgkkh_mpkl_QdwgDodLMUSm2yeDbcRFg4GTEvC_IxQ Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: c21d140d48ba4014bc470e8cf720785d Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:10:19.625638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:10:19.627286 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c21d140d48ba4014bc470e8cf720785d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c21d140d48ba4014bc470e8cf720785d"}]}] Sep 23 14:10:19.627286 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:19.627286 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: c21d140d48ba4014bc470e8cf720785d Sep 23 14:10:19.627286 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1453461522 Sep 23 14:10:19.627286 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-AttachVolumeShelveTestJSON-1453461522-project Sep 23 14:10:19.627286 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:10:19.627286 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:10:19.627286 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: d777c43fe5c142b3b5ea5e2485f4e49f Sep 23 14:10:19.627286 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1453461522-project Sep 23 14:10:19.627286 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:10:19.627286 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:10:19.627286 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '97557fbe-c1f4-464e-93b8-3c71fbc48936'} Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:10:19.628258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. Sep 23 14:10:19.629703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:10:19.632176 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-456197f8-de72-4117-a564-d42ae0b7dd51 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] Returning 404 to user: Instance 97557fbe-c1f4-464e-93b8-3c71fbc48936 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:10:19.632176 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-456197f8-de72-4117-a564-d42ae0b7dd51 tempest-AttachVolumeShelveTestJSON-1453461522 tempest-AttachVolumeShelveTestJSON-1453461522-project] 10.222.0.62 "GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936" status: 404 len: 111 microversion: 2.20 time: 0.031074 Sep 23 14:10:19.632176 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 426/853] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 23 14:10:19 2022] GET /compute/v2.1/servers/97557fbe-c1f4-464e-93b8-3c71fbc48936 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 14:10:20.067958 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b0172349-ce3e-4d9b-9c14-1b73ed5147d4 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:20.068657 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b0172349-ce3e-4d9b-9c14-1b73ed5147d4 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:20.075044 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b0172349-ce3e-4d9b-9c14-1b73ed5147d4 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:20.075545 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b0172349-ce3e-4d9b-9c14-1b73ed5147d4 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:20.075987 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b0172349-ce3e-4d9b-9c14-1b73ed5147d4 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:20.076687 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b0172349-ce3e-4d9b-9c14-1b73ed5147d4 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:20.077220 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b0172349-ce3e-4d9b-9c14-1b73ed5147d4 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:20.077644 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b0172349-ce3e-4d9b-9c14-1b73ed5147d4 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:20.231170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b0172349-ce3e-4d9b-9c14-1b73ed5147d4 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:20.240515 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b0172349-ce3e-4d9b-9c14-1b73ed5147d4 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1504 microversion: 2.1 time: 0.176146 Sep 23 14:10:20.241296 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 428/854] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:20 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:21.265199 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8f46607c-3a20-41da-9e7c-e5e2870682d9 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:21.266426 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-8f46607c-3a20-41da-9e7c-e5e2870682d9 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:21.275162 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f46607c-3a20-41da-9e7c-e5e2870682d9 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:21.277856 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f46607c-3a20-41da-9e7c-e5e2870682d9 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:21.280305 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f46607c-3a20-41da-9e7c-e5e2870682d9 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:21.282202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f46607c-3a20-41da-9e7c-e5e2870682d9 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:21.285732 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f46607c-3a20-41da-9e7c-e5e2870682d9 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:21.287251 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f46607c-3a20-41da-9e7c-e5e2870682d9 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:21.344617 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-545a780c-79bb-4c4b-a2f5-4cf9c865cf80 req-46f6df2e-215e-4903-a354-c519dc5926f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c937b4-c14c-4761-83ff-cf16703c0818", "name": "network-vif-deleted", "tag": "8a2f6a36-e9df-41f2-ae66-3fad8840d659"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:21.363561 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-545a780c-79bb-4c4b-a2f5-4cf9c865cf80 req-46f6df2e-215e-4903-a354-c519dc5926f3 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:21.363967 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-545a780c-79bb-4c4b-a2f5-4cf9c865cf80 req-46f6df2e-215e-4903-a354-c519dc5926f3 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:21.364963 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-545a780c-79bb-4c4b-a2f5-4cf9c865cf80 req-46f6df2e-215e-4903-a354-c519dc5926f3 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:21.380484 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-8f46607c-3a20-41da-9e7c-e5e2870682d9 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:21.384319 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-545a780c-79bb-4c4b-a2f5-4cf9c865cf80 req-46f6df2e-215e-4903-a354-c519dc5926f3 service nova] Creating event network-vif-deleted:8a2f6a36-e9df-41f2-ae66-3fad8840d659 for instance e9c937b4-c14c-4761-83ff-cf16703c0818 on hv-cinder-85743 Sep 23 14:10:21.388610 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8f46607c-3a20-41da-9e7c-e5e2870682d9 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1462 microversion: 2.1 time: 0.127935 Sep 23 14:10:21.390896 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 427/855] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:21 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1462 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:21.394584 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-545a780c-79bb-4c4b-a2f5-4cf9c865cf80 req-46f6df2e-215e-4903-a354-c519dc5926f3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053731 Sep 23 14:10:21.395161 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 429/856] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:10:22.412423 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-32c59cf5-e870-4be8-8fbe-6bfbee2e8625 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:22.413138 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-32c59cf5-e870-4be8-8fbe-6bfbee2e8625 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:22.427182 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32c59cf5-e870-4be8-8fbe-6bfbee2e8625 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:22.427676 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32c59cf5-e870-4be8-8fbe-6bfbee2e8625 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:22.428121 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32c59cf5-e870-4be8-8fbe-6bfbee2e8625 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:22.428885 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32c59cf5-e870-4be8-8fbe-6bfbee2e8625 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:22.429304 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32c59cf5-e870-4be8-8fbe-6bfbee2e8625 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:22.429734 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32c59cf5-e870-4be8-8fbe-6bfbee2e8625 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:22.462248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32c59cf5-e870-4be8-8fbe-6bfbee2e8625 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:22.462779 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32c59cf5-e870-4be8-8fbe-6bfbee2e8625 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:22.463211 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32c59cf5-e870-4be8-8fbe-6bfbee2e8625 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:22.463651 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-32c59cf5-e870-4be8-8fbe-6bfbee2e8625 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lazy-loading 'fault' on Instance uuid e9c937b4-c14c-4761-83ff-cf16703c0818 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:10:22.509179 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-32c59cf5-e870-4be8-8fbe-6bfbee2e8625 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:22.518436 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-32c59cf5-e870-4be8-8fbe-6bfbee2e8625 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 200 len: 1304 microversion: 2.1 time: 0.110111 Sep 23 14:10:22.531257 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 428/857] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:22 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:23.542462 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-de14bd79-a530-4adc-8bc1-0001efaa81b5 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:23.543298 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-de14bd79-a530-4adc-8bc1-0001efaa81b5 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: e9c937b4-c14c-4761-83ff-cf16703c0818] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:23.549776 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-de14bd79-a530-4adc-8bc1-0001efaa81b5 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:23.550274 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-de14bd79-a530-4adc-8bc1-0001efaa81b5 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:23.550740 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-de14bd79-a530-4adc-8bc1-0001efaa81b5 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:23.551463 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-de14bd79-a530-4adc-8bc1-0001efaa81b5 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:23.551986 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-de14bd79-a530-4adc-8bc1-0001efaa81b5 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:23.553117 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-de14bd79-a530-4adc-8bc1-0001efaa81b5 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:23.566694 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-de14bd79-a530-4adc-8bc1-0001efaa81b5 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] HTTP exception thrown: Instance e9c937b4-c14c-4761-83ff-cf16703c0818 could not be found. Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-de14bd79-a530-4adc-8bc1-0001efaa81b5 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Request method failure captured: Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 HTTP/1.1 Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLb4656ZizJRNhk71nco4FpGHcn0OlehQnJZnYe2AVabJPlN3At2UcPkc6sdwNidDNQGEoajwP8TIOyC0UIVqhvW69Z6S1_c61RZksuNV1IjOmSdE9yfbt3CMAKj1_yLtnm2o6FawYVlhnRXrSZ84lHhkANsi4oXWMCg59dEJ3laB0-w Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: c4ce494070ca4b76a93a6a4a9f42414c Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-VolumesActionsTest-762350336 Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:10:23.569540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:10:23.585102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c4ce494070ca4b76a93a6a4a9f42414c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c4ce494070ca4b76a93a6a4a9f42414c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c4ce494070ca4b76a93a6a4a9f42414c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c4ce494070ca4b76a93a6a4a9f42414c"}]}] Sep 23 14:10:23.585102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-VolumesActionsTest-762350336 Sep 23 14:10:23.585102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: c4ce494070ca4b76a93a6a4a9f42414c Sep 23 14:10:23.585102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-VolumesActionsTest-762350336 Sep 23 14:10:23.585102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-VolumesActionsTest-762350336-project Sep 23 14:10:23.585102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:10:23.585102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:10:23.585102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 256d2963df4c4e48876583485de59674 Sep 23 14:10:23.585102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-VolumesActionsTest-762350336-project Sep 23 14:10:23.585102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:10:23.585102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance e9c937b4-c14c-4761-83ff-cf16703c0818 could not be found. Sep 23 14:10:23.585102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': 'e9c937b4-c14c-4761-83ff-cf16703c0818'} Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c937b4-c14c-4761-83ff-cf16703c0818 could not be found. Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:10:23.586256 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c937b4-c14c-4761-83ff-cf16703c0818 could not be found. Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c937b4-c14c-4761-83ff-cf16703c0818 could not be found. Sep 23 14:10:23.587507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:23.589151 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-de14bd79-a530-4adc-8bc1-0001efaa81b5 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Returning 404 to user: Instance e9c937b4-c14c-4761-83ff-cf16703c0818 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:10:23.589151 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-de14bd79-a530-4adc-8bc1-0001efaa81b5 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818" status: 404 len: 111 microversion: 2.1 time: 0.032953 Sep 23 14:10:23.589151 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 430/858] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:23 2022] GET /compute/v2.1/servers/e9c937b4-c14c-4761-83ff-cf16703c0818 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 14:10:23.633929 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-149277943", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "networks": [{"uuid": "7d566560-6d05-4813-af89-28dc8e1f05bf"}]}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:23.701662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.network.neutron [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] validate_networks() for [('7d566560-6d05-4813-af89-28dc8e1f05bf', None, None, None, None, None)] {{(pid=121073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:10:24.117786 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Flavor limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:10:24.118266 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Image limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:10:24.118787 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Flavor pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:10:24.119302 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Image pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:10:24.119723 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:10:24.128643 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:24.129168 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:24.129601 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:24.131036 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:24.131503 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:24.131950 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:24.150615 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Getting quotas for project c4ce494070ca4b76a93a6a4a9f42414c. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:10:24.155770 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Getting quotas for user 256d2963df4c4e48876583485de59674 and project c4ce494070ca4b76a93a6a4a9f42414c. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:10:24.167693 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Going to run 1 instances... {{(pid=121073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:10:24.170110 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:10:24.321875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e48acade-0f3b-42f4-97db-6cf5db45d065 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691996 Sep 23 14:10:24.329649 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 429/859] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:10:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 14:10:24.337542 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4c0c3566-1c4f-4fa4-8a2b-9c683b992784 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:24.341654 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4c0c3566-1c4f-4fa4-8a2b-9c683b992784 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:24.435070 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4c0c3566-1c4f-4fa4-8a2b-9c683b992784 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:24.446709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4c0c3566-1c4f-4fa4-8a2b-9c683b992784 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1213 microversion: 2.1 time: 0.115004 Sep 23 14:10:24.447763 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 431/860] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:24 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:25.473398 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5bd4e4d5-a373-48f2-ae3a-b1087612b670 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:25.475097 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5bd4e4d5-a373-48f2-ae3a-b1087612b670 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:25.481062 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bd4e4d5-a373-48f2-ae3a-b1087612b670 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:25.481558 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bd4e4d5-a373-48f2-ae3a-b1087612b670 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:25.481991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bd4e4d5-a373-48f2-ae3a-b1087612b670 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:25.482731 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bd4e4d5-a373-48f2-ae3a-b1087612b670 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:25.483182 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bd4e4d5-a373-48f2-ae3a-b1087612b670 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:25.483604 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bd4e4d5-a373-48f2-ae3a-b1087612b670 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:25.488165 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:25.559234 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5bd4e4d5-a373-48f2-ae3a-b1087612b670 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:25.567346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5bd4e4d5-a373-48f2-ae3a-b1087612b670 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1217 microversion: 2.1 time: 0.097845 Sep 23 14:10:25.567964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 430/861] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:25 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:26.592547 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a3207ca7-94ee-4723-8f36-a2660bd02bc0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:26.593136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a3207ca7-94ee-4723-8f36-a2660bd02bc0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:26.599673 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a3207ca7-94ee-4723-8f36-a2660bd02bc0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:26.600377 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a3207ca7-94ee-4723-8f36-a2660bd02bc0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:26.600811 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a3207ca7-94ee-4723-8f36-a2660bd02bc0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:26.601542 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a3207ca7-94ee-4723-8f36-a2660bd02bc0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:26.601992 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a3207ca7-94ee-4723-8f36-a2660bd02bc0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:26.602445 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a3207ca7-94ee-4723-8f36-a2660bd02bc0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:26.669135 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a3207ca7-94ee-4723-8f36-a2660bd02bc0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:26.678655 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a3207ca7-94ee-4723-8f36-a2660bd02bc0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1265 microversion: 2.1 time: 0.089894 Sep 23 14:10:26.679219 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 432/862] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:26 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:27.701603 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ecd2c505-22fc-4187-bdca-58920ea369b0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:27.703147 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ecd2c505-22fc-4187-bdca-58920ea369b0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:27.711824 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ecd2c505-22fc-4187-bdca-58920ea369b0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:27.712813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ecd2c505-22fc-4187-bdca-58920ea369b0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:27.713528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ecd2c505-22fc-4187-bdca-58920ea369b0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:27.714555 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ecd2c505-22fc-4187-bdca-58920ea369b0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:27.715236 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ecd2c505-22fc-4187-bdca-58920ea369b0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:27.715882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ecd2c505-22fc-4187-bdca-58920ea369b0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:27.909903 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ecd2c505-22fc-4187-bdca-58920ea369b0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:27.917451 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ecd2c505-22fc-4187-bdca-58920ea369b0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1313 microversion: 2.1 time: 0.220102 Sep 23 14:10:27.918014 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 431/863] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:27 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:28.947103 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-14f75611-aa47-4bd3-93bd-4e66160ffe16 req-44889cd4-e0f7-4f15-9046-3bff8efe25b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28a9e76-7867-4804-88d1-714fa4a61917", "tag": "e4bc7ac7-47a5-427a-9423-da4525f55285"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:28.947672 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-f3485cda-3866-4b63-a093-244c3bae2a46 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:28.947672 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-f3485cda-3866-4b63-a093-244c3bae2a46 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:28.954245 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f3485cda-3866-4b63-a093-244c3bae2a46 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:28.954781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f3485cda-3866-4b63-a093-244c3bae2a46 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:28.955239 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f3485cda-3866-4b63-a093-244c3bae2a46 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:28.955940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f3485cda-3866-4b63-a093-244c3bae2a46 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:28.956395 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f3485cda-3866-4b63-a093-244c3bae2a46 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:28.956823 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-f3485cda-3866-4b63-a093-244c3bae2a46 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:28.960707 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-14f75611-aa47-4bd3-93bd-4e66160ffe16 req-44889cd4-e0f7-4f15-9046-3bff8efe25b9 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:28.960707 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-14f75611-aa47-4bd3-93bd-4e66160ffe16 req-44889cd4-e0f7-4f15-9046-3bff8efe25b9 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:28.960969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-14f75611-aa47-4bd3-93bd-4e66160ffe16 req-44889cd4-e0f7-4f15-9046-3bff8efe25b9 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:28.977554 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-14f75611-aa47-4bd3-93bd-4e66160ffe16 req-44889cd4-e0f7-4f15-9046-3bff8efe25b9 service nova] Creating event network-changed:e4bc7ac7-47a5-427a-9423-da4525f55285 for instance d28a9e76-7867-4804-88d1-714fa4a61917 on hv-cinder-85743 Sep 23 14:10:28.983109 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-14f75611-aa47-4bd3-93bd-4e66160ffe16 req-44889cd4-e0f7-4f15-9046-3bff8efe25b9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051005 Sep 23 14:10:28.984196 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 433/864] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:10:29.470112 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-f3485cda-3866-4b63-a093-244c3bae2a46 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:29.479788 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-f3485cda-3866-4b63-a093-244c3bae2a46 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1313 microversion: 2.1 time: 0.542466 Sep 23 14:10:29.480565 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 432/865] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:28 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:10:30.503051 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-66c927df-dbdb-46cc-864d-25152bd9be16 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:30.508766 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-66c927df-dbdb-46cc-864d-25152bd9be16 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:30.511981 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66c927df-dbdb-46cc-864d-25152bd9be16 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:30.518170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66c927df-dbdb-46cc-864d-25152bd9be16 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:30.518904 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66c927df-dbdb-46cc-864d-25152bd9be16 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:30.519894 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66c927df-dbdb-46cc-864d-25152bd9be16 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:30.520552 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66c927df-dbdb-46cc-864d-25152bd9be16 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:30.521352 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66c927df-dbdb-46cc-864d-25152bd9be16 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:30.734508 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-66c927df-dbdb-46cc-864d-25152bd9be16 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:30.742776 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-66c927df-dbdb-46cc-864d-25152bd9be16 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1313 microversion: 2.1 time: 0.243567 Sep 23 14:10:30.743359 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 434/866] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:30 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:31.769509 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-0a69a9c5-d367-4a1f-8b2e-185989af6471 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:31.770128 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-0a69a9c5-d367-4a1f-8b2e-185989af6471 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:31.777047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a69a9c5-d367-4a1f-8b2e-185989af6471 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:31.777569 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a69a9c5-d367-4a1f-8b2e-185989af6471 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:31.777949 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a69a9c5-d367-4a1f-8b2e-185989af6471 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:31.778876 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a69a9c5-d367-4a1f-8b2e-185989af6471 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:31.779273 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a69a9c5-d367-4a1f-8b2e-185989af6471 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:31.779865 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a69a9c5-d367-4a1f-8b2e-185989af6471 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:31.938162 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-0a69a9c5-d367-4a1f-8b2e-185989af6471 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:31.948235 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-0a69a9c5-d367-4a1f-8b2e-185989af6471 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1313 microversion: 2.1 time: 0.186858 Sep 23 14:10:31.948994 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 433/867] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:31 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:32.038198 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d35e0ae6-c373-4018-9498-92adbdc2c94f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Action: 'create', calling method: .version_select at 0x7f9083e77790>, body: {"keypair": {"name": "tempest-keypair-786975622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuJTnrBsY/ZhytydLjxFyHRiE4LNrc25Q84HcI/86dsH6eye6Z4DcP1zldYcu2BPuolIQyfnrNoPHu/aHi4wqmBNELOCdjnAXar2wpuTHOU8+YLFR20p7Jl4gIRPD2RGQ=="}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:32.058562 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-d35e0ae6-c373-4018-9498-92adbdc2c94f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Getting quotas for project 403c04c19c0c45398d6b232c03a4b7a6. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:10:32.061763 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-d35e0ae6-c373-4018-9498-92adbdc2c94f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Getting quotas for user 1e18b5b70f8b4939bebae2d7ef261740 and project 403c04c19c0c45398d6b232c03a4b7a6. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:10:32.076242 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d35e0ae6-c373-4018-9498-92adbdc2c94f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [0b8ac930-1ffd-46f4-87c6-8e340d45be1d] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 14:10:32.974270 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a152c474-f8b4-4a85-a24e-6f3ded653480 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:32.975061 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a152c474-f8b4-4a85-a24e-6f3ded653480 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:32.981339 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a152c474-f8b4-4a85-a24e-6f3ded653480 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:32.981827 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a152c474-f8b4-4a85-a24e-6f3ded653480 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:32.982264 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a152c474-f8b4-4a85-a24e-6f3ded653480 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:32.982978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a152c474-f8b4-4a85-a24e-6f3ded653480 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:32.983437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a152c474-f8b4-4a85-a24e-6f3ded653480 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:32.983862 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a152c474-f8b4-4a85-a24e-6f3ded653480 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:33.083617 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO oslo.messaging._drivers.impl_rabbit [None req-d35e0ae6-c373-4018-9498-92adbdc2c94f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [0b8ac930-1ffd-46f4-87c6-8e340d45be1d] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 48990. Sep 23 14:10:33.129274 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a152c474-f8b4-4a85-a24e-6f3ded653480 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:33.137717 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a152c474-f8b4-4a85-a24e-6f3ded653480 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1313 microversion: 2.1 time: 0.167311 Sep 23 14:10:33.138975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 434/868] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:32 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:10:33.179095 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d35e0ae6-c373-4018-9498-92adbdc2c94f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.314408 Sep 23 14:10:33.179828 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 435/869] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 23 14:10:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:10:34.162480 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d754cb90-61bf-4c1e-ac76-8d0cb0f770e2 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:34.163241 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d754cb90-61bf-4c1e-ac76-8d0cb0f770e2 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:34.166800 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:34.167587 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=6 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:34.171276 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d754cb90-61bf-4c1e-ac76-8d0cb0f770e2 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:34.172082 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d754cb90-61bf-4c1e-ac76-8d0cb0f770e2 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:34.172555 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d754cb90-61bf-4c1e-ac76-8d0cb0f770e2 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:34.173354 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d754cb90-61bf-4c1e-ac76-8d0cb0f770e2 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:34.173886 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d754cb90-61bf-4c1e-ac76-8d0cb0f770e2 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:34.174408 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d754cb90-61bf-4c1e-ac76-8d0cb0f770e2 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:34.318686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d754cb90-61bf-4c1e-ac76-8d0cb0f770e2 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:34.327059 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d754cb90-61bf-4c1e-ac76-8d0cb0f770e2 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1313 microversion: 2.1 time: 0.169980 Sep 23 14:10:34.327639 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 435/870] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:34 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:35.352192 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e247ac3e-c916-4439-8432-a8ed818cce52 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:35.353413 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e247ac3e-c916-4439-8432-a8ed818cce52 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:35.361057 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e247ac3e-c916-4439-8432-a8ed818cce52 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:35.361560 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e247ac3e-c916-4439-8432-a8ed818cce52 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:35.362002 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e247ac3e-c916-4439-8432-a8ed818cce52 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:35.363013 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e247ac3e-c916-4439-8432-a8ed818cce52 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:35.363650 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e247ac3e-c916-4439-8432-a8ed818cce52 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:35.364310 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e247ac3e-c916-4439-8432-a8ed818cce52 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:35.508258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e247ac3e-c916-4439-8432-a8ed818cce52 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:35.515820 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e247ac3e-c916-4439-8432-a8ed818cce52 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1313 microversion: 2.1 time: 0.168489 Sep 23 14:10:35.517021 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 436/871] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:35 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:35.697590 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1298744368", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef3d91d5-5a9a-46ba-ba3d-c86fbc383224"}], "security_groups": [{"name": "tempest-securitygroup--361408573"}], "key_name": "tempest-keypair-786975622", "user_data": "}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:35.706477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:35.803002 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.network.neutron [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] validate_networks() for [('ef3d91d5-5a9a-46ba-ba3d-c86fbc383224', None, None, None, None, None)] {{(pid=121073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:10:36.185209 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Flavor limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:10:36.185638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Image limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:10:36.186121 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Flavor pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:10:36.186575 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Image pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:10:36.187026 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:10:36.196785 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:36.197394 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:36.197834 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:36.198632 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:36.204068 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:36.208047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:36.224270 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Getting quotas for project 403c04c19c0c45398d6b232c03a4b7a6. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:10:36.228213 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Getting quotas for user 1e18b5b70f8b4939bebae2d7ef261740 and project 403c04c19c0c45398d6b232c03a4b7a6. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:10:36.239919 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Going to run 1 instances... {{(pid=121073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:10:36.242113 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:10:36.424769 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-bf63e8bb-0430-4c39-8253-0d9db7249fb9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.731991 Sep 23 14:10:36.425418 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 436/872] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:10:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 14:10:36.437692 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e3d8efce-cd42-4864-8609-d4bd30f735fa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:36.439537 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e3d8efce-cd42-4864-8609-d4bd30f735fa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:36.503180 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e3d8efce-cd42-4864-8609-d4bd30f735fa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:36.514056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e3d8efce-cd42-4864-8609-d4bd30f735fa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1237 microversion: 2.1 time: 0.080167 Sep 23 14:10:36.514681 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 437/873] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:36 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:36.540780 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4dc9801e-86e0-4204-aa5f-6024aaea23b1 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:36.541428 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4dc9801e-86e0-4204-aa5f-6024aaea23b1 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:36.548288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4dc9801e-86e0-4204-aa5f-6024aaea23b1 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:36.548778 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4dc9801e-86e0-4204-aa5f-6024aaea23b1 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:36.549214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4dc9801e-86e0-4204-aa5f-6024aaea23b1 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:36.549909 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4dc9801e-86e0-4204-aa5f-6024aaea23b1 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:36.550388 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4dc9801e-86e0-4204-aa5f-6024aaea23b1 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:36.550820 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4dc9801e-86e0-4204-aa5f-6024aaea23b1 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:36.686124 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4dc9801e-86e0-4204-aa5f-6024aaea23b1 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:36.690952 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-2005505e-de8f-4786-836e-72c2d7efa881 req-cac6ca1d-bd06-4cd5-8b8c-6f9a74f1d556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28a9e76-7867-4804-88d1-714fa4a61917", "name": "network-vif-plugged", "status": "completed", "tag": "e4bc7ac7-47a5-427a-9423-da4525f55285"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:36.694185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4dc9801e-86e0-4204-aa5f-6024aaea23b1 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1313 microversion: 2.1 time: 0.158003 Sep 23 14:10:36.695076 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 437/874] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:36 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:36.701782 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-2005505e-de8f-4786-836e-72c2d7efa881 req-cac6ca1d-bd06-4cd5-8b8c-6f9a74f1d556 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:36.702266 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-2005505e-de8f-4786-836e-72c2d7efa881 req-cac6ca1d-bd06-4cd5-8b8c-6f9a74f1d556 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:36.702724 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-2005505e-de8f-4786-836e-72c2d7efa881 req-cac6ca1d-bd06-4cd5-8b8c-6f9a74f1d556 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:36.714005 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-2005505e-de8f-4786-836e-72c2d7efa881 req-cac6ca1d-bd06-4cd5-8b8c-6f9a74f1d556 service nova] Creating event network-vif-plugged:e4bc7ac7-47a5-427a-9423-da4525f55285 for instance d28a9e76-7867-4804-88d1-714fa4a61917 on hv-cinder-85743 Sep 23 14:10:36.719096 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-2005505e-de8f-4786-836e-72c2d7efa881 req-cac6ca1d-bd06-4cd5-8b8c-6f9a74f1d556 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031870 Sep 23 14:10:36.719686 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 438/875] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:10:37.536066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e6cef965-a1d8-4daf-a64a-460a2b336cbc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:37.536704 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e6cef965-a1d8-4daf-a64a-460a2b336cbc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:37.592507 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e6cef965-a1d8-4daf-a64a-460a2b336cbc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:37.599360 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e6cef965-a1d8-4daf-a64a-460a2b336cbc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1237 microversion: 2.1 time: 0.067298 Sep 23 14:10:37.599908 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 438/876] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:37 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:37.718836 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-bb9e5353-b044-4472-91d6-f65e25e57a07 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:37.719533 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-bb9e5353-b044-4472-91d6-f65e25e57a07 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:37.721470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:37.726506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bb9e5353-b044-4472-91d6-f65e25e57a07 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:37.726994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bb9e5353-b044-4472-91d6-f65e25e57a07 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:37.727433 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bb9e5353-b044-4472-91d6-f65e25e57a07 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:37.728118 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bb9e5353-b044-4472-91d6-f65e25e57a07 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:37.728576 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bb9e5353-b044-4472-91d6-f65e25e57a07 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:37.729001 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bb9e5353-b044-4472-91d6-f65e25e57a07 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:37.732847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:37.859630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-bb9e5353-b044-4472-91d6-f65e25e57a07 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:37.867826 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-bb9e5353-b044-4472-91d6-f65e25e57a07 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1313 microversion: 2.1 time: 0.153334 Sep 23 14:10:37.870351 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 439/877] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:37 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:38.622726 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a5c3685c-746c-4586-bfd2-6d58ae258335 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:38.623242 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a5c3685c-746c-4586-bfd2-6d58ae258335 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:38.630878 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a5c3685c-746c-4586-bfd2-6d58ae258335 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:38.631397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a5c3685c-746c-4586-bfd2-6d58ae258335 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:38.631828 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a5c3685c-746c-4586-bfd2-6d58ae258335 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:38.632510 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a5c3685c-746c-4586-bfd2-6d58ae258335 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:38.632964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a5c3685c-746c-4586-bfd2-6d58ae258335 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:38.633388 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a5c3685c-746c-4586-bfd2-6d58ae258335 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:38.696027 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a5c3685c-746c-4586-bfd2-6d58ae258335 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:38.704322 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a5c3685c-746c-4586-bfd2-6d58ae258335 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1233 microversion: 2.1 time: 0.085475 Sep 23 14:10:38.705626 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 439/878] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:38 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1233 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:38.891018 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ff14204c-1e00-4585-a633-4bf5056c8bd8 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:38.891630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ff14204c-1e00-4585-a633-4bf5056c8bd8 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:38.898602 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff14204c-1e00-4585-a633-4bf5056c8bd8 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:38.899081 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff14204c-1e00-4585-a633-4bf5056c8bd8 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:38.899514 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff14204c-1e00-4585-a633-4bf5056c8bd8 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:38.900243 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff14204c-1e00-4585-a633-4bf5056c8bd8 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:38.900709 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff14204c-1e00-4585-a633-4bf5056c8bd8 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:38.901111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ff14204c-1e00-4585-a633-4bf5056c8bd8 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:39.034407 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ff14204c-1e00-4585-a633-4bf5056c8bd8 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:39.042266 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ff14204c-1e00-4585-a633-4bf5056c8bd8 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1313 microversion: 2.1 time: 0.154985 Sep 23 14:10:39.043034 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 440/879] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:38 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:39.737379 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-02115136-9247-4e7e-9934-b61e4e80fec6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:39.737379 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-02115136-9247-4e7e-9934-b61e4e80fec6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:39.739665 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-02115136-9247-4e7e-9934-b61e4e80fec6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:39.740248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-02115136-9247-4e7e-9934-b61e4e80fec6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:39.740692 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-02115136-9247-4e7e-9934-b61e4e80fec6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:39.741383 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-02115136-9247-4e7e-9934-b61e4e80fec6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:39.741844 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-02115136-9247-4e7e-9934-b61e4e80fec6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:39.742274 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-02115136-9247-4e7e-9934-b61e4e80fec6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:39.803823 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-02115136-9247-4e7e-9934-b61e4e80fec6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:39.811687 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-02115136-9247-4e7e-9934-b61e4e80fec6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1289 microversion: 2.1 time: 0.082805 Sep 23 14:10:39.812257 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 440/880] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:39 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:40.065386 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-233f3562-6ef0-4bbc-8cda-b098664b19f0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:40.066107 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-233f3562-6ef0-4bbc-8cda-b098664b19f0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:40.073014 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-233f3562-6ef0-4bbc-8cda-b098664b19f0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:40.073508 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-233f3562-6ef0-4bbc-8cda-b098664b19f0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:40.073952 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-233f3562-6ef0-4bbc-8cda-b098664b19f0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:40.074693 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-233f3562-6ef0-4bbc-8cda-b098664b19f0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:40.075161 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-233f3562-6ef0-4bbc-8cda-b098664b19f0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:40.075595 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-233f3562-6ef0-4bbc-8cda-b098664b19f0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:40.257157 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-233f3562-6ef0-4bbc-8cda-b098664b19f0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:40.265264 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-233f3562-6ef0-4bbc-8cda-b098664b19f0 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1497 microversion: 2.1 time: 0.203519 Sep 23 14:10:40.265781 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 441/881] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:40 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1497 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:40.835429 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-93f10cfa-7288-4085-bd25-91f4b0473a81 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:40.835899 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-93f10cfa-7288-4085-bd25-91f4b0473a81 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:40.842571 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93f10cfa-7288-4085-bd25-91f4b0473a81 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:40.843091 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93f10cfa-7288-4085-bd25-91f4b0473a81 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:40.843561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93f10cfa-7288-4085-bd25-91f4b0473a81 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:40.844256 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93f10cfa-7288-4085-bd25-91f4b0473a81 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:40.844715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93f10cfa-7288-4085-bd25-91f4b0473a81 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:40.845140 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93f10cfa-7288-4085-bd25-91f4b0473a81 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:40.907290 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-93f10cfa-7288-4085-bd25-91f4b0473a81 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:40.916155 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-93f10cfa-7288-4085-bd25-91f4b0473a81 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1295 microversion: 2.1 time: 0.084766 Sep 23 14:10:40.917046 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 441/882] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:40 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:41.276674 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0c83b6f3-73b5-4c1c-8d03-a36ffaef76d6 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:41.277187 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-0c83b6f3-73b5-4c1c-8d03-a36ffaef76d6 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:41.282987 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0c83b6f3-73b5-4c1c-8d03-a36ffaef76d6 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:41.284693 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0c83b6f3-73b5-4c1c-8d03-a36ffaef76d6 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:41.284693 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0c83b6f3-73b5-4c1c-8d03-a36ffaef76d6 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:41.284693 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0c83b6f3-73b5-4c1c-8d03-a36ffaef76d6 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:41.285112 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0c83b6f3-73b5-4c1c-8d03-a36ffaef76d6 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:41.285543 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0c83b6f3-73b5-4c1c-8d03-a36ffaef76d6 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:41.310545 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-0c83b6f3-73b5-4c1c-8d03-a36ffaef76d6 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Going to try to terminate instance {{(pid=121074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:10:41.610547 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-0c83b6f3-73b5-4c1c-8d03-a36ffaef76d6 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 204 len: 0 microversion: 2.1 time: 0.337279 Sep 23 14:10:41.611143 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 442/883] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:10:41 2022] DELETE /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:10:41.619492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-27942e7e-4d4b-4071-8dd4-7acfa3b0617f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:41.624589 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-27942e7e-4d4b-4071-8dd4-7acfa3b0617f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:41.626603 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27942e7e-4d4b-4071-8dd4-7acfa3b0617f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:41.627111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27942e7e-4d4b-4071-8dd4-7acfa3b0617f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:41.627559 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27942e7e-4d4b-4071-8dd4-7acfa3b0617f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:41.628253 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27942e7e-4d4b-4071-8dd4-7acfa3b0617f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:41.628717 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27942e7e-4d4b-4071-8dd4-7acfa3b0617f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:41.629147 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27942e7e-4d4b-4071-8dd4-7acfa3b0617f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:41.813617 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-27942e7e-4d4b-4071-8dd4-7acfa3b0617f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:41.821515 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-27942e7e-4d4b-4071-8dd4-7acfa3b0617f tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1503 microversion: 2.1 time: 0.205907 Sep 23 14:10:41.825465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 442/884] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:41 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:41.940878 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-03bc39d5-f067-4bd3-9d09-32d0cdfc27ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:41.941603 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-03bc39d5-f067-4bd3-9d09-32d0cdfc27ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:41.947524 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-03bc39d5-f067-4bd3-9d09-32d0cdfc27ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:41.948040 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-03bc39d5-f067-4bd3-9d09-32d0cdfc27ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:41.948477 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-03bc39d5-f067-4bd3-9d09-32d0cdfc27ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:41.949164 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-03bc39d5-f067-4bd3-9d09-32d0cdfc27ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:41.949615 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-03bc39d5-f067-4bd3-9d09-32d0cdfc27ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:41.950037 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-03bc39d5-f067-4bd3-9d09-32d0cdfc27ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:42.053065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-9d5dfe15-3ff3-44ce-87e5-ea4636ef772d req-a07fbef3-8fe8-40b8-aa8d-4ff285f78afa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13eef24f-a406-4677-9362-460ce72549d8", "tag": "b3bc1447-0566-4e4f-a72e-99041644a80b"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:42.064730 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-9d5dfe15-3ff3-44ce-87e5-ea4636ef772d req-a07fbef3-8fe8-40b8-aa8d-4ff285f78afa service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:42.065209 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-9d5dfe15-3ff3-44ce-87e5-ea4636ef772d req-a07fbef3-8fe8-40b8-aa8d-4ff285f78afa service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:42.065640 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-9d5dfe15-3ff3-44ce-87e5-ea4636ef772d req-a07fbef3-8fe8-40b8-aa8d-4ff285f78afa service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:42.078592 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-9d5dfe15-3ff3-44ce-87e5-ea4636ef772d req-a07fbef3-8fe8-40b8-aa8d-4ff285f78afa service nova] Creating event network-changed:b3bc1447-0566-4e4f-a72e-99041644a80b for instance 13eef24f-a406-4677-9362-460ce72549d8 on hv-cinder-85743 Sep 23 14:10:42.084326 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-9d5dfe15-3ff3-44ce-87e5-ea4636ef772d req-a07fbef3-8fe8-40b8-aa8d-4ff285f78afa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034869 Sep 23 14:10:42.085099 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 443/885] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:10:42.141958 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-03bc39d5-f067-4bd3-9d09-32d0cdfc27ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:42.150548 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-03bc39d5-f067-4bd3-9d09-32d0cdfc27ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1362 microversion: 2.1 time: 0.213917 Sep 23 14:10:42.151203 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 443/886] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:41 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:42.845978 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e4ac5a7e-c19e-48dd-a1a7-fa2d8437bb23 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:42.846712 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e4ac5a7e-c19e-48dd-a1a7-fa2d8437bb23 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:42.853213 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e4ac5a7e-c19e-48dd-a1a7-fa2d8437bb23 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:42.853877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e4ac5a7e-c19e-48dd-a1a7-fa2d8437bb23 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:42.854210 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e4ac5a7e-c19e-48dd-a1a7-fa2d8437bb23 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:42.854952 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e4ac5a7e-c19e-48dd-a1a7-fa2d8437bb23 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:42.855412 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e4ac5a7e-c19e-48dd-a1a7-fa2d8437bb23 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:42.855839 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e4ac5a7e-c19e-48dd-a1a7-fa2d8437bb23 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:43.019078 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e4ac5a7e-c19e-48dd-a1a7-fa2d8437bb23 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:43.027001 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e4ac5a7e-c19e-48dd-a1a7-fa2d8437bb23 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1503 microversion: 2.1 time: 0.185432 Sep 23 14:10:43.027568 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 444/887] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:42 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:43.173166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-bea22c3e-9680-4a85-805f-b6a9db17b544 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:43.173815 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-bea22c3e-9680-4a85-805f-b6a9db17b544 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:43.181086 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bea22c3e-9680-4a85-805f-b6a9db17b544 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:43.181834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bea22c3e-9680-4a85-805f-b6a9db17b544 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:43.182269 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bea22c3e-9680-4a85-805f-b6a9db17b544 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:43.183005 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bea22c3e-9680-4a85-805f-b6a9db17b544 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:43.183465 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bea22c3e-9680-4a85-805f-b6a9db17b544 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:43.183892 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-bea22c3e-9680-4a85-805f-b6a9db17b544 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:43.388290 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-bea22c3e-9680-4a85-805f-b6a9db17b544 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:43.396670 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-bea22c3e-9680-4a85-805f-b6a9db17b544 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1362 microversion: 2.1 time: 0.227533 Sep 23 14:10:43.397323 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 444/888] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:43 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:43.747810 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-1be780e2-d99c-40e3-a44e-f9e6cbe100ee req-12e41464-4be4-40ac-8e6d-4d4026b01078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28a9e76-7867-4804-88d1-714fa4a61917", "name": "network-vif-deleted", "tag": "e4bc7ac7-47a5-427a-9423-da4525f55285"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:43.759061 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-1be780e2-d99c-40e3-a44e-f9e6cbe100ee req-12e41464-4be4-40ac-8e6d-4d4026b01078 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:43.759592 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-1be780e2-d99c-40e3-a44e-f9e6cbe100ee req-12e41464-4be4-40ac-8e6d-4d4026b01078 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:43.760018 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-1be780e2-d99c-40e3-a44e-f9e6cbe100ee req-12e41464-4be4-40ac-8e6d-4d4026b01078 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:43.771861 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-1be780e2-d99c-40e3-a44e-f9e6cbe100ee req-12e41464-4be4-40ac-8e6d-4d4026b01078 service nova] Creating event network-vif-deleted:e4bc7ac7-47a5-427a-9423-da4525f55285 for instance d28a9e76-7867-4804-88d1-714fa4a61917 on hv-cinder-85743 Sep 23 14:10:43.776708 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-1be780e2-d99c-40e3-a44e-f9e6cbe100ee req-12e41464-4be4-40ac-8e6d-4d4026b01078 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033211 Sep 23 14:10:43.777296 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 445/889] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:10:44.050831 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-557ae680-0914-4610-853a-adaf7189fa12 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:44.051442 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-557ae680-0914-4610-853a-adaf7189fa12 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:44.058460 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-557ae680-0914-4610-853a-adaf7189fa12 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:44.058945 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-557ae680-0914-4610-853a-adaf7189fa12 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:44.059382 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-557ae680-0914-4610-853a-adaf7189fa12 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:44.060062 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-557ae680-0914-4610-853a-adaf7189fa12 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:44.060519 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-557ae680-0914-4610-853a-adaf7189fa12 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:44.060944 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-557ae680-0914-4610-853a-adaf7189fa12 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:44.090799 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-557ae680-0914-4610-853a-adaf7189fa12 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:44.091279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-557ae680-0914-4610-853a-adaf7189fa12 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:44.091716 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-557ae680-0914-4610-853a-adaf7189fa12 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:44.092157 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-557ae680-0914-4610-853a-adaf7189fa12 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lazy-loading 'fault' on Instance uuid d28a9e76-7867-4804-88d1-714fa4a61917 {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:10:44.134156 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-557ae680-0914-4610-853a-adaf7189fa12 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:44.141984 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-557ae680-0914-4610-853a-adaf7189fa12 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1303 microversion: 2.1 time: 0.095098 Sep 23 14:10:44.142794 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 445/890] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:44 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:44.420605 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e9261071-7fa5-4d5a-a1d3-407dfaaee52d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:44.421220 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e9261071-7fa5-4d5a-a1d3-407dfaaee52d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:44.427725 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9261071-7fa5-4d5a-a1d3-407dfaaee52d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:44.428217 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9261071-7fa5-4d5a-a1d3-407dfaaee52d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:44.428650 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9261071-7fa5-4d5a-a1d3-407dfaaee52d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:44.429361 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9261071-7fa5-4d5a-a1d3-407dfaaee52d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:44.429840 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9261071-7fa5-4d5a-a1d3-407dfaaee52d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:44.430265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9261071-7fa5-4d5a-a1d3-407dfaaee52d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:44.562947 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e9261071-7fa5-4d5a-a1d3-407dfaaee52d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:44.571419 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e9261071-7fa5-4d5a-a1d3-407dfaaee52d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1362 microversion: 2.1 time: 0.155120 Sep 23 14:10:44.571976 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 446/891] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:44 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:45.165481 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-71b65d67-09e1-4b8d-8211-4eb6f5a1356c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:45.166151 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-71b65d67-09e1-4b8d-8211-4eb6f5a1356c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:45.172137 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-71b65d67-09e1-4b8d-8211-4eb6f5a1356c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:45.172620 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-71b65d67-09e1-4b8d-8211-4eb6f5a1356c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:45.173054 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-71b65d67-09e1-4b8d-8211-4eb6f5a1356c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:45.173742 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-71b65d67-09e1-4b8d-8211-4eb6f5a1356c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:45.174229 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-71b65d67-09e1-4b8d-8211-4eb6f5a1356c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:45.174638 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-71b65d67-09e1-4b8d-8211-4eb6f5a1356c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:45.207623 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-71b65d67-09e1-4b8d-8211-4eb6f5a1356c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:45.208189 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-71b65d67-09e1-4b8d-8211-4eb6f5a1356c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:45.208600 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-71b65d67-09e1-4b8d-8211-4eb6f5a1356c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:45.209152 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-71b65d67-09e1-4b8d-8211-4eb6f5a1356c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lazy-loading 'fault' on Instance uuid d28a9e76-7867-4804-88d1-714fa4a61917 {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:10:45.249791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-71b65d67-09e1-4b8d-8211-4eb6f5a1356c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256d2963df4c4e48876583485de59674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ce494070ca4b76a93a6a4a9f42414c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:45.258104 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-71b65d67-09e1-4b8d-8211-4eb6f5a1356c tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 200 len: 1303 microversion: 2.1 time: 0.096591 Sep 23 14:10:45.258703 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 446/892] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:45 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:45.595578 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-84de2284-e2bc-4fc0-9689-1ff46c17e9c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:45.596228 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-84de2284-e2bc-4fc0-9689-1ff46c17e9c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:45.603283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-84de2284-e2bc-4fc0-9689-1ff46c17e9c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:45.603770 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-84de2284-e2bc-4fc0-9689-1ff46c17e9c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:45.604210 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-84de2284-e2bc-4fc0-9689-1ff46c17e9c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:45.604896 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-84de2284-e2bc-4fc0-9689-1ff46c17e9c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:45.605353 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-84de2284-e2bc-4fc0-9689-1ff46c17e9c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:45.605778 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-84de2284-e2bc-4fc0-9689-1ff46c17e9c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:45.734224 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-84de2284-e2bc-4fc0-9689-1ff46c17e9c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:45.742469 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-84de2284-e2bc-4fc0-9689-1ff46c17e9c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1362 microversion: 2.1 time: 0.150654 Sep 23 14:10:45.743228 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 447/893] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:45 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:46.283574 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-daefb87d-a98d-4cf6-8a35-7b1b05a33e05 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:46.283574 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-daefb87d-a98d-4cf6-8a35-7b1b05a33e05 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] [instance: d28a9e76-7867-4804-88d1-714fa4a61917] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:46.287551 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-daefb87d-a98d-4cf6-8a35-7b1b05a33e05 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:46.288040 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-daefb87d-a98d-4cf6-8a35-7b1b05a33e05 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:46.288518 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-daefb87d-a98d-4cf6-8a35-7b1b05a33e05 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:46.289211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-daefb87d-a98d-4cf6-8a35-7b1b05a33e05 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:46.289670 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-daefb87d-a98d-4cf6-8a35-7b1b05a33e05 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:46.290093 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-daefb87d-a98d-4cf6-8a35-7b1b05a33e05 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:46.303809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-daefb87d-a98d-4cf6-8a35-7b1b05a33e05 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] HTTP exception thrown: Instance d28a9e76-7867-4804-88d1-714fa4a61917 could not be found. Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-daefb87d-a98d-4cf6-8a35-7b1b05a33e05 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Request method failure captured: Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 HTTP/1.1 Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLb4656ZizJRNhk71nco4FpGHcn0OlehQnJZnYe2AVabJPlN3At2UcPkc6sdwNidDNQGEoajwP8TIOyC0UIVqhvW69Z6S1_c61RZksuNV1IjOmSdE9yfbt3CMAKj1_yLtnm2o6FawYVlhnRXrSZ84lHhkANsi4oXWMCg59dEJ3laB0-w Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: c4ce494070ca4b76a93a6a4a9f42414c Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-VolumesActionsTest-762350336 Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:10:46.305448 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:10:46.307179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c4ce494070ca4b76a93a6a4a9f42414c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c4ce494070ca4b76a93a6a4a9f42414c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c4ce494070ca4b76a93a6a4a9f42414c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c4ce494070ca4b76a93a6a4a9f42414c"}]}] Sep 23 14:10:46.307179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-VolumesActionsTest-762350336 Sep 23 14:10:46.307179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: c4ce494070ca4b76a93a6a4a9f42414c Sep 23 14:10:46.307179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-VolumesActionsTest-762350336 Sep 23 14:10:46.307179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-VolumesActionsTest-762350336-project Sep 23 14:10:46.307179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:10:46.307179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:10:46.307179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 256d2963df4c4e48876583485de59674 Sep 23 14:10:46.307179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-VolumesActionsTest-762350336-project Sep 23 14:10:46.307179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:10:46.307179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance d28a9e76-7867-4804-88d1-714fa4a61917 could not be found. Sep 23 14:10:46.307179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': 'd28a9e76-7867-4804-88d1-714fa4a61917'} Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28a9e76-7867-4804-88d1-714fa4a61917 could not be found. Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:10:46.307966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28a9e76-7867-4804-88d1-714fa4a61917 could not be found. Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28a9e76-7867-4804-88d1-714fa4a61917 could not be found. Sep 23 14:10:46.309280 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:46.310565 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-daefb87d-a98d-4cf6-8a35-7b1b05a33e05 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] Returning 404 to user: Instance d28a9e76-7867-4804-88d1-714fa4a61917 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:10:46.310565 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-daefb87d-a98d-4cf6-8a35-7b1b05a33e05 tempest-VolumesActionsTest-762350336 tempest-VolumesActionsTest-762350336-project] 10.222.0.62 "GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917" status: 404 len: 111 microversion: 2.1 time: 0.030985 Sep 23 14:10:46.310565 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 447/894] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:46 2022] GET /compute/v2.1/servers/d28a9e76-7867-4804-88d1-714fa4a61917 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:10:46.766019 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9dac3612-bcd4-4506-b2cc-ff129eb6d670 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:46.766817 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9dac3612-bcd4-4506-b2cc-ff129eb6d670 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:46.776355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:46.779048 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9dac3612-bcd4-4506-b2cc-ff129eb6d670 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:46.779662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9dac3612-bcd4-4506-b2cc-ff129eb6d670 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:46.780209 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9dac3612-bcd4-4506-b2cc-ff129eb6d670 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:46.781110 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9dac3612-bcd4-4506-b2cc-ff129eb6d670 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:46.782225 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9dac3612-bcd4-4506-b2cc-ff129eb6d670 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:46.782892 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9dac3612-bcd4-4506-b2cc-ff129eb6d670 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:47.204098 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9dac3612-bcd4-4506-b2cc-ff129eb6d670 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:47.227545 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9dac3612-bcd4-4506-b2cc-ff129eb6d670 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1362 microversion: 2.1 time: 0.463794 Sep 23 14:10:47.228758 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 448/895] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:46 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1362 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:47.496166 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-9cf5891c-c9bd-4180-9de4-23f07cb2a3e0 req-1163c5cc-b31a-4682-8ffc-aec0992b2d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3cf38f-b2d0-465c-9f91-7b04e669be1a", "tag": "ddb61f77-2e1f-4d02-bd20-42e3ca25c62d"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:47.497638 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-cc3e8cea-c242-4bdf-8229-7e8558628b5d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:47.498161 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-cc3e8cea-c242-4bdf-8229-7e8558628b5d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:47.501441 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=8 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:47.505963 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cc3e8cea-c242-4bdf-8229-7e8558628b5d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:47.506741 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cc3e8cea-c242-4bdf-8229-7e8558628b5d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:47.507241 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cc3e8cea-c242-4bdf-8229-7e8558628b5d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:47.508049 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-9cf5891c-c9bd-4180-9de4-23f07cb2a3e0 req-1163c5cc-b31a-4682-8ffc-aec0992b2d32 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:47.508180 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cc3e8cea-c242-4bdf-8229-7e8558628b5d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:47.508613 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cc3e8cea-c242-4bdf-8229-7e8558628b5d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:47.509055 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cc3e8cea-c242-4bdf-8229-7e8558628b5d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:47.509332 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-9cf5891c-c9bd-4180-9de4-23f07cb2a3e0 req-1163c5cc-b31a-4682-8ffc-aec0992b2d32 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:47.509873 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-9cf5891c-c9bd-4180-9de4-23f07cb2a3e0 req-1163c5cc-b31a-4682-8ffc-aec0992b2d32 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:47.523934 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-9cf5891c-c9bd-4180-9de4-23f07cb2a3e0 req-1163c5cc-b31a-4682-8ffc-aec0992b2d32 service nova] Creating event network-changed:ddb61f77-2e1f-4d02-bd20-42e3ca25c62d for instance ae3cf38f-b2d0-465c-9f91-7b04e669be1a on hv-cinder-85743 Sep 23 14:10:47.529450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-9cf5891c-c9bd-4180-9de4-23f07cb2a3e0 req-1163c5cc-b31a-4682-8ffc-aec0992b2d32 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036821 Sep 23 14:10:47.530244 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 449/896] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:10:47.537822 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-cc3e8cea-c242-4bdf-8229-7e8558628b5d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Going to try to terminate instance {{(pid=121074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:10:47.855584 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-cc3e8cea-c242-4bdf-8229-7e8558628b5d tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 204 len: 0 microversion: 2.1 time: 0.367968 Sep 23 14:10:47.856544 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 448/897] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:10:47 2022] DELETE /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:10:47.867029 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8540f122-9c20-4f23-8f9d-67e36b054a3c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:47.867940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-8540f122-9c20-4f23-8f9d-67e36b054a3c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:47.870076 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=8 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:47.876281 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8540f122-9c20-4f23-8f9d-67e36b054a3c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:47.876942 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8540f122-9c20-4f23-8f9d-67e36b054a3c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:47.877510 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8540f122-9c20-4f23-8f9d-67e36b054a3c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:47.878288 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8540f122-9c20-4f23-8f9d-67e36b054a3c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:47.878992 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8540f122-9c20-4f23-8f9d-67e36b054a3c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:47.879506 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8540f122-9c20-4f23-8f9d-67e36b054a3c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:47.903550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=100 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:48.022556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-8540f122-9c20-4f23-8f9d-67e36b054a3c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:48.030981 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8540f122-9c20-4f23-8f9d-67e36b054a3c tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.169955 Sep 23 14:10:48.031582 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 450/898] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:47 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:48.255875 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b640e677-5539-4277-bcdf-2e0974362c90 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:48.257011 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b640e677-5539-4277-bcdf-2e0974362c90 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:48.263287 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b640e677-5539-4277-bcdf-2e0974362c90 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:48.263777 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b640e677-5539-4277-bcdf-2e0974362c90 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:48.264214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b640e677-5539-4277-bcdf-2e0974362c90 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:48.264901 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b640e677-5539-4277-bcdf-2e0974362c90 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:48.265354 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b640e677-5539-4277-bcdf-2e0974362c90 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:48.265776 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b640e677-5539-4277-bcdf-2e0974362c90 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:48.401210 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b640e677-5539-4277-bcdf-2e0974362c90 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:48.409436 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b640e677-5539-4277-bcdf-2e0974362c90 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1362 microversion: 2.1 time: 0.158459 Sep 23 14:10:48.410014 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 449/899] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:48 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:49.057717 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-be16eddf-d0f0-42d2-84c3-598a5abd8eba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:49.058238 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-be16eddf-d0f0-42d2-84c3-598a5abd8eba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:49.065446 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-be16eddf-d0f0-42d2-84c3-598a5abd8eba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:49.065936 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-be16eddf-d0f0-42d2-84c3-598a5abd8eba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:49.066557 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-be16eddf-d0f0-42d2-84c3-598a5abd8eba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:49.067151 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-be16eddf-d0f0-42d2-84c3-598a5abd8eba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:49.068202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-be16eddf-d0f0-42d2-84c3-598a5abd8eba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:49.068637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-be16eddf-d0f0-42d2-84c3-598a5abd8eba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:49.195312 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-be16eddf-d0f0-42d2-84c3-598a5abd8eba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:49.203191 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-be16eddf-d0f0-42d2-84c3-598a5abd8eba tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.150961 Sep 23 14:10:49.203783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 451/900] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:49 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:49.432225 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-c386b7f9-483a-42b2-a5bf-3121d2e56410 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:49.432745 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-c386b7f9-483a-42b2-a5bf-3121d2e56410 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:49.438703 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c386b7f9-483a-42b2-a5bf-3121d2e56410 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:49.439214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c386b7f9-483a-42b2-a5bf-3121d2e56410 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:49.439657 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c386b7f9-483a-42b2-a5bf-3121d2e56410 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:49.440351 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c386b7f9-483a-42b2-a5bf-3121d2e56410 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:49.440810 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c386b7f9-483a-42b2-a5bf-3121d2e56410 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:49.441244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c386b7f9-483a-42b2-a5bf-3121d2e56410 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:49.572447 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-c386b7f9-483a-42b2-a5bf-3121d2e56410 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:49.580132 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-c386b7f9-483a-42b2-a5bf-3121d2e56410 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1362 microversion: 2.1 time: 0.152213 Sep 23 14:10:49.580702 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 450/901] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:49 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:50.225957 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9ba9a108-ef66-4a3b-b353-0b50067e028f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:50.226605 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9ba9a108-ef66-4a3b-b353-0b50067e028f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:50.233005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9ba9a108-ef66-4a3b-b353-0b50067e028f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:50.233495 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9ba9a108-ef66-4a3b-b353-0b50067e028f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:50.233935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9ba9a108-ef66-4a3b-b353-0b50067e028f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:50.234654 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9ba9a108-ef66-4a3b-b353-0b50067e028f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:50.235114 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9ba9a108-ef66-4a3b-b353-0b50067e028f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:50.235540 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9ba9a108-ef66-4a3b-b353-0b50067e028f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:50.368500 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9ba9a108-ef66-4a3b-b353-0b50067e028f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:50.376075 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9ba9a108-ef66-4a3b-b353-0b50067e028f tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1568 microversion: 2.1 time: 0.154054 Sep 23 14:10:50.376633 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 452/902] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:50 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:50.604454 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-273068d8-34d6-438d-8454-2de47f120cf2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:50.605082 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-273068d8-34d6-438d-8454-2de47f120cf2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:50.611327 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-273068d8-34d6-438d-8454-2de47f120cf2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:50.611808 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-273068d8-34d6-438d-8454-2de47f120cf2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:50.612238 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-273068d8-34d6-438d-8454-2de47f120cf2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:50.612964 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-273068d8-34d6-438d-8454-2de47f120cf2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:50.614796 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-273068d8-34d6-438d-8454-2de47f120cf2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:50.614796 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-273068d8-34d6-438d-8454-2de47f120cf2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:50.741086 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-273068d8-34d6-438d-8454-2de47f120cf2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:50.748531 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-273068d8-34d6-438d-8454-2de47f120cf2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1362 microversion: 2.1 time: 0.148052 Sep 23 14:10:50.749089 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 451/903] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:50 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:51.015520 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-b2230327-981b-4018-b837-519bfad4655c req-1c5a9625-35c6-4896-85c1-dab6784266e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13eef24f-a406-4677-9362-460ce72549d8", "name": "network-vif-plugged", "status": "completed", "tag": "b3bc1447-0566-4e4f-a72e-99041644a80b"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:51.026394 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-b2230327-981b-4018-b837-519bfad4655c req-1c5a9625-35c6-4896-85c1-dab6784266e9 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:51.030167 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-b2230327-981b-4018-b837-519bfad4655c req-1c5a9625-35c6-4896-85c1-dab6784266e9 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:51.030167 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-b2230327-981b-4018-b837-519bfad4655c req-1c5a9625-35c6-4896-85c1-dab6784266e9 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:51.038958 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-b2230327-981b-4018-b837-519bfad4655c req-1c5a9625-35c6-4896-85c1-dab6784266e9 service nova] Creating event network-vif-plugged:b3bc1447-0566-4e4f-a72e-99041644a80b for instance 13eef24f-a406-4677-9362-460ce72549d8 on hv-cinder-85743 Sep 23 14:10:51.044029 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-b2230327-981b-4018-b837-519bfad4655c req-1c5a9625-35c6-4896-85c1-dab6784266e9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032170 Sep 23 14:10:51.044673 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 453/904] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:10:51.399394 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6be96775-e882-46a6-87b9-891d108a4e21 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:51.400098 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6be96775-e882-46a6-87b9-891d108a4e21 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:51.405962 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6be96775-e882-46a6-87b9-891d108a4e21 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:51.406481 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6be96775-e882-46a6-87b9-891d108a4e21 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:51.406922 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6be96775-e882-46a6-87b9-891d108a4e21 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:51.407603 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6be96775-e882-46a6-87b9-891d108a4e21 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:51.408056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6be96775-e882-46a6-87b9-891d108a4e21 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:51.408520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6be96775-e882-46a6-87b9-891d108a4e21 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:51.425214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:51.540833 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6be96775-e882-46a6-87b9-891d108a4e21 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:51.548483 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6be96775-e882-46a6-87b9-891d108a4e21 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1450 microversion: 2.1 time: 0.152947 Sep 23 14:10:51.549086 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 452/905] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:51 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:51.772399 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5bb1df6e-1fc6-45ee-9f02-2bdc7a72247b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:51.773180 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5bb1df6e-1fc6-45ee-9f02-2bdc7a72247b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:51.780159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bb1df6e-1fc6-45ee-9f02-2bdc7a72247b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:51.780729 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bb1df6e-1fc6-45ee-9f02-2bdc7a72247b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:51.781336 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bb1df6e-1fc6-45ee-9f02-2bdc7a72247b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:51.782044 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bb1df6e-1fc6-45ee-9f02-2bdc7a72247b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:51.782537 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bb1df6e-1fc6-45ee-9f02-2bdc7a72247b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:51.782968 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5bb1df6e-1fc6-45ee-9f02-2bdc7a72247b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:51.923604 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5bb1df6e-1fc6-45ee-9f02-2bdc7a72247b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:51.931933 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5bb1df6e-1fc6-45ee-9f02-2bdc7a72247b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1362 microversion: 2.1 time: 0.164356 Sep 23 14:10:51.932492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 454/906] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:51 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:52.574394 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e580be87-6ed8-4655-bc9f-76968a8913c9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:52.575655 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e580be87-6ed8-4655-bc9f-76968a8913c9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:52.583681 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e580be87-6ed8-4655-bc9f-76968a8913c9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:52.584439 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e580be87-6ed8-4655-bc9f-76968a8913c9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:52.585050 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e580be87-6ed8-4655-bc9f-76968a8913c9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:52.585917 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e580be87-6ed8-4655-bc9f-76968a8913c9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:52.586991 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e580be87-6ed8-4655-bc9f-76968a8913c9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:52.587596 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e580be87-6ed8-4655-bc9f-76968a8913c9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:52.601629 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-605ee58a-4cd9-4290-8a4e-9173741b8222 req-cb2172b9-bdd4-4336-bb99-3fb17b91d21f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3cf38f-b2d0-465c-9f91-7b04e669be1a", "name": "network-vif-deleted", "tag": "ddb61f77-2e1f-4d02-bd20-42e3ca25c62d"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:52.612217 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-605ee58a-4cd9-4290-8a4e-9173741b8222 req-cb2172b9-bdd4-4336-bb99-3fb17b91d21f service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:52.613003 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-605ee58a-4cd9-4290-8a4e-9173741b8222 req-cb2172b9-bdd4-4336-bb99-3fb17b91d21f service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:52.613648 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-605ee58a-4cd9-4290-8a4e-9173741b8222 req-cb2172b9-bdd4-4336-bb99-3fb17b91d21f service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:52.626012 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-605ee58a-4cd9-4290-8a4e-9173741b8222 req-cb2172b9-bdd4-4336-bb99-3fb17b91d21f service nova] Creating event network-vif-deleted:ddb61f77-2e1f-4d02-bd20-42e3ca25c62d for instance ae3cf38f-b2d0-465c-9f91-7b04e669be1a on hv-cinder-85743 Sep 23 14:10:52.632124 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-605ee58a-4cd9-4290-8a4e-9173741b8222 req-cb2172b9-bdd4-4336-bb99-3fb17b91d21f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036659 Sep 23 14:10:52.632787 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 455/907] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:10:52.691420 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e580be87-6ed8-4655-bc9f-76968a8913c9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:52.702788 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e580be87-6ed8-4655-bc9f-76968a8913c9 tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1383 microversion: 2.1 time: 0.133405 Sep 23 14:10:52.703677 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 453/908] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:52 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1383 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:52.960895 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-69e523a9-80a4-4979-8139-80b3a9f54bba tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:52.961607 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-69e523a9-80a4-4979-8139-80b3a9f54bba tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:52.970975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-69e523a9-80a4-4979-8139-80b3a9f54bba tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:52.971482 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-69e523a9-80a4-4979-8139-80b3a9f54bba tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:52.971986 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-69e523a9-80a4-4979-8139-80b3a9f54bba tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:52.972903 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-69e523a9-80a4-4979-8139-80b3a9f54bba tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:52.974084 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-69e523a9-80a4-4979-8139-80b3a9f54bba tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:52.974572 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-69e523a9-80a4-4979-8139-80b3a9f54bba tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:53.127525 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-69e523a9-80a4-4979-8139-80b3a9f54bba tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:53.146221 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-69e523a9-80a4-4979-8139-80b3a9f54bba tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1362 microversion: 2.1 time: 0.188522 Sep 23 14:10:53.148717 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 456/909] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:52 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:53.730724 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4d02a528-b48c-423f-9351-8f597b83c24a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:53.731686 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4d02a528-b48c-423f-9351-8f597b83c24a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:53.739770 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4d02a528-b48c-423f-9351-8f597b83c24a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:53.740832 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4d02a528-b48c-423f-9351-8f597b83c24a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:53.741488 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4d02a528-b48c-423f-9351-8f597b83c24a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:53.742538 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4d02a528-b48c-423f-9351-8f597b83c24a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:53.743206 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4d02a528-b48c-423f-9351-8f597b83c24a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:53.743880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4d02a528-b48c-423f-9351-8f597b83c24a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:53.818379 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4d02a528-b48c-423f-9351-8f597b83c24a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:53.827139 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4d02a528-b48c-423f-9351-8f597b83c24a tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1220 microversion: 2.1 time: 0.100197 Sep 23 14:10:53.828115 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 454/910] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:53 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:54.175138 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e8adcd1a-23b2-413c-a262-96db6b7e7bb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:54.175995 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e8adcd1a-23b2-413c-a262-96db6b7e7bb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:54.188216 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e8adcd1a-23b2-413c-a262-96db6b7e7bb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:54.188882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e8adcd1a-23b2-413c-a262-96db6b7e7bb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:54.189316 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e8adcd1a-23b2-413c-a262-96db6b7e7bb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:54.190027 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e8adcd1a-23b2-413c-a262-96db6b7e7bb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:54.190559 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e8adcd1a-23b2-413c-a262-96db6b7e7bb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:54.191311 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e8adcd1a-23b2-413c-a262-96db6b7e7bb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:54.372526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e8adcd1a-23b2-413c-a262-96db6b7e7bb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:54.382145 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e8adcd1a-23b2-413c-a262-96db6b7e7bb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1549 microversion: 2.1 time: 0.212744 Sep 23 14:10:54.383038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 457/911] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:54 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1549 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:54.409834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-63bfef0d-4c15-4514-a410-f6ce068bc79c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:54.411431 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-63bfef0d-4c15-4514-a410-f6ce068bc79c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:54.419126 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63bfef0d-4c15-4514-a410-f6ce068bc79c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:54.419699 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63bfef0d-4c15-4514-a410-f6ce068bc79c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:54.420173 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63bfef0d-4c15-4514-a410-f6ce068bc79c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:54.420862 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63bfef0d-4c15-4514-a410-f6ce068bc79c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:54.421486 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63bfef0d-4c15-4514-a410-f6ce068bc79c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:54.421908 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63bfef0d-4c15-4514-a410-f6ce068bc79c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:54.512967 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-63bfef0d-4c15-4514-a410-f6ce068bc79c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107658 Sep 23 14:10:54.514573 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 455/912] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 23 14:10:54 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:10:54.856542 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c6d741d7-3ca5-4c5b-b124-4c067edb787e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:54.857742 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c6d741d7-3ca5-4c5b-b124-4c067edb787e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:54.866376 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6d741d7-3ca5-4c5b-b124-4c067edb787e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:54.867439 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6d741d7-3ca5-4c5b-b124-4c067edb787e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:54.868124 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6d741d7-3ca5-4c5b-b124-4c067edb787e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:54.869082 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6d741d7-3ca5-4c5b-b124-4c067edb787e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:54.869555 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6d741d7-3ca5-4c5b-b124-4c067edb787e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:54.870024 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6d741d7-3ca5-4c5b-b124-4c067edb787e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:54.912371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6d741d7-3ca5-4c5b-b124-4c067edb787e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:54.912899 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6d741d7-3ca5-4c5b-b124-4c067edb787e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:54.913658 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c6d741d7-3ca5-4c5b-b124-4c067edb787e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:54.914058 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-c6d741d7-3ca5-4c5b-b124-4c067edb787e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lazy-loading 'fault' on Instance uuid ae3cf38f-b2d0-465c-9f91-7b04e669be1a {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:10:54.967663 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c6d741d7-3ca5-4c5b-b124-4c067edb787e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad2b6e8ec52485488f27ea84f2c69cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728460a287914347b74cfe886f56ee6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:10:54.979522 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c6d741d7-3ca5-4c5b-b124-4c067edb787e tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 200 len: 1225 microversion: 2.1 time: 0.127076 Sep 23 14:10:54.980949 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 458/913] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:54 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:10:56.010053 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9e72fc6d-fb35-47bf-aad4-e08148cf39ce tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:56.016269 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-9e72fc6d-fb35-47bf-aad4-e08148cf39ce tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] [instance: ae3cf38f-b2d0-465c-9f91-7b04e669be1a] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:10:56.017081 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9e72fc6d-fb35-47bf-aad4-e08148cf39ce tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:56.017533 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9e72fc6d-fb35-47bf-aad4-e08148cf39ce tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:56.017974 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9e72fc6d-fb35-47bf-aad4-e08148cf39ce tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:56.018705 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9e72fc6d-fb35-47bf-aad4-e08148cf39ce tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:56.019589 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9e72fc6d-fb35-47bf-aad4-e08148cf39ce tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:56.020919 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9e72fc6d-fb35-47bf-aad4-e08148cf39ce tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:56.044007 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-9e72fc6d-fb35-47bf-aad4-e08148cf39ce tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] HTTP exception thrown: Instance ae3cf38f-b2d0-465c-9f91-7b04e669be1a could not be found. Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9e72fc6d-fb35-47bf-aad4-e08148cf39ce tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Request method failure captured: Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a HTTP/1.1 Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLb0mb3U93CMAOuRWgE4Acu41jh84HuZt4xuREbglhI9RcYllzzZjDpelq2UK4o_XmoOp5SDE_ghXSRqWSunll_pZcWMxR1KmmhNyTitd85UairDU-GkZMWvFS-OSzkPV_Q9qn6wfugWz6zXHP6v-MwTVppYan70mtI8eGN_YjHMKgiE Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 728460a287914347b74cfe886f56ee6c Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-TestShelveInstance-1487927433 Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:10:56.045806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:10:56.047318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/728460a287914347b74cfe886f56ee6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/728460a287914347b74cfe886f56ee6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/728460a287914347b74cfe886f56ee6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_728460a287914347b74cfe886f56ee6c"}]}] Sep 23 14:10:56.047318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-TestShelveInstance-1487927433 Sep 23 14:10:56.047318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 728460a287914347b74cfe886f56ee6c Sep 23 14:10:56.047318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-TestShelveInstance-1487927433 Sep 23 14:10:56.047318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-TestShelveInstance-1487927433-project Sep 23 14:10:56.047318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:10:56.047318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:10:56.047318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 4ad2b6e8ec52485488f27ea84f2c69cc Sep 23 14:10:56.047318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-TestShelveInstance-1487927433-project Sep 23 14:10:56.047318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:10:56.047318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance ae3cf38f-b2d0-465c-9f91-7b04e669be1a could not be found. Sep 23 14:10:56.047318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': 'ae3cf38f-b2d0-465c-9f91-7b04e669be1a'} Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae3cf38f-b2d0-465c-9f91-7b04e669be1a could not be found. Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:10:56.048191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae3cf38f-b2d0-465c-9f91-7b04e669be1a could not be found. Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae3cf38f-b2d0-465c-9f91-7b04e669be1a could not be found. Sep 23 14:10:56.049507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:10:56.052414 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9e72fc6d-fb35-47bf-aad4-e08148cf39ce tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Returning 404 to user: Instance ae3cf38f-b2d0-465c-9f91-7b04e669be1a could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:10:56.052414 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-9e72fc6d-fb35-47bf-aad4-e08148cf39ce tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a" status: 404 len: 111 microversion: 2.1 time: 0.043075 Sep 23 14:10:56.052414 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 456/914] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:10:56 2022] GET /compute/v2.1/servers/ae3cf38f-b2d0-465c-9f91-7b04e669be1a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:10:56.441995 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-940d2fcb-20db-4f0d-8482-0f375a5e4a01 req-f027011b-743b-4846-8786-448e65c705c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13eef24f-a406-4677-9362-460ce72549d8", "tag": "b3bc1447-0566-4e4f-a72e-99041644a80b"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:10:56.458958 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-940d2fcb-20db-4f0d-8482-0f375a5e4a01 req-f027011b-743b-4846-8786-448e65c705c7 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:10:56.459772 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-940d2fcb-20db-4f0d-8482-0f375a5e4a01 req-f027011b-743b-4846-8786-448e65c705c7 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:10:56.460423 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-940d2fcb-20db-4f0d-8482-0f375a5e4a01 req-f027011b-743b-4846-8786-448e65c705c7 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:10:56.486446 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-940d2fcb-20db-4f0d-8482-0f375a5e4a01 req-f027011b-743b-4846-8786-448e65c705c7 service nova] Creating event network-changed:b3bc1447-0566-4e4f-a72e-99041644a80b for instance 13eef24f-a406-4677-9362-460ce72549d8 on hv-cinder-85743 Sep 23 14:10:56.495626 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-940d2fcb-20db-4f0d-8482-0f375a5e4a01 req-f027011b-743b-4846-8786-448e65c705c7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060539 Sep 23 14:10:56.498789 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 459/915] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:10:56.550166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-dc34a6b4-8c7b-4835-95dc-329acfb5badf tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] Calling method '.version_select at 0x7f9083b91ee0>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:10:56.630864 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-dc34a6b4-8c7b-4835-95dc-329acfb5badf tempest-TestShelveInstance-1487927433 tempest-TestShelveInstance-1487927433-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1589397812" status: 202 len: 0 microversion: 2.1 time: 0.084209 Sep 23 14:10:56.635055 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 457/916] 10.222.0.62 () {58 vars in 1254 bytes} [Fri Sep 23 14:10:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1589397812 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:11:25.183438 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=21 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:11:25.184248 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:11:25.188007 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-f2d35e35-e802-4bd0-a631-0a627c17015e req-f3d51178-0e9e-4f7c-ac73-80b0c85479ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a08d7c5-4906-498e-980d-ec6d35ba8bee", "tag": "bebfb579-fd1e-4f01-81d1-df4839bfbcc5"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:11:25.196329 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-03e61c8d-92f9-4d0c-a332-c18f84dcb2aa tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:25.196964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-03e61c8d-92f9-4d0c-a332-c18f84dcb2aa tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:25.203593 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f2d35e35-e802-4bd0-a631-0a627c17015e req-f3d51178-0e9e-4f7c-ac73-80b0c85479ff service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:25.203593 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f2d35e35-e802-4bd0-a631-0a627c17015e req-f3d51178-0e9e-4f7c-ac73-80b0c85479ff service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:25.203593 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f2d35e35-e802-4bd0-a631-0a627c17015e req-f3d51178-0e9e-4f7c-ac73-80b0c85479ff service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:25.203943 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:11:25.203943 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=46 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:11:25.205782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03e61c8d-92f9-4d0c-a332-c18f84dcb2aa tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:25.206280 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03e61c8d-92f9-4d0c-a332-c18f84dcb2aa tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:25.206749 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03e61c8d-92f9-4d0c-a332-c18f84dcb2aa tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:25.213375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03e61c8d-92f9-4d0c-a332-c18f84dcb2aa tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:25.213375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03e61c8d-92f9-4d0c-a332-c18f84dcb2aa tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:25.213375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-03e61c8d-92f9-4d0c-a332-c18f84dcb2aa tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:25.217183 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-f2d35e35-e802-4bd0-a631-0a627c17015e req-f3d51178-0e9e-4f7c-ac73-80b0c85479ff service nova] Creating event network-changed:bebfb579-fd1e-4f01-81d1-df4839bfbcc5 for instance 6a08d7c5-4906-498e-980d-ec6d35ba8bee on hv-cinder-85743 Sep 23 14:11:25.222838 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-f2d35e35-e802-4bd0-a631-0a627c17015e req-f3d51178-0e9e-4f7c-ac73-80b0c85479ff service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040343 Sep 23 14:11:25.223664 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 458/917] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:11:25.235526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-03e61c8d-92f9-4d0c-a332-c18f84dcb2aa tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Going to try to terminate instance {{(pid=121073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:11:25.534483 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-03e61c8d-92f9-4d0c-a332-c18f84dcb2aa tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 204 len: 0 microversion: 2.1 time: 0.356030 Sep 23 14:11:25.540329 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 460/918] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:11:25 2022] DELETE /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:11:25.546784 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-cbc0172c-86d5-4a7c-9088-4bc85c4be340 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:25.548005 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-cbc0172c-86d5-4a7c-9088-4bc85c4be340 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:25.570168 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cbc0172c-86d5-4a7c-9088-4bc85c4be340 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:25.571057 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cbc0172c-86d5-4a7c-9088-4bc85c4be340 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:25.572752 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cbc0172c-86d5-4a7c-9088-4bc85c4be340 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:25.574079 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cbc0172c-86d5-4a7c-9088-4bc85c4be340 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:25.575318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cbc0172c-86d5-4a7c-9088-4bc85c4be340 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:25.576038 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cbc0172c-86d5-4a7c-9088-4bc85c4be340 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:25.723166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-cbc0172c-86d5-4a7c-9088-4bc85c4be340 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:25.731924 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-cbc0172c-86d5-4a7c-9088-4bc85c4be340 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1577 microversion: 2.1 time: 0.189654 Sep 23 14:11:25.732534 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 459/919] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:25 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:11:26.756800 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3b9a76b4-b5e2-4905-8429-f38470f3b979 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:26.758105 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3b9a76b4-b5e2-4905-8429-f38470f3b979 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:26.765391 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3b9a76b4-b5e2-4905-8429-f38470f3b979 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:26.765882 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3b9a76b4-b5e2-4905-8429-f38470f3b979 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:26.766343 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3b9a76b4-b5e2-4905-8429-f38470f3b979 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:26.767046 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3b9a76b4-b5e2-4905-8429-f38470f3b979 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:26.767542 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3b9a76b4-b5e2-4905-8429-f38470f3b979 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:26.767999 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3b9a76b4-b5e2-4905-8429-f38470f3b979 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:26.918116 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3b9a76b4-b5e2-4905-8429-f38470f3b979 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:26.931191 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3b9a76b4-b5e2-4905-8429-f38470f3b979 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1577 microversion: 2.1 time: 0.178425 Sep 23 14:11:26.932687 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 461/920] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:26 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:11:27.957989 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f651cb21-b193-46f8-bbd0-064173d72813 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:27.959136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f651cb21-b193-46f8-bbd0-064173d72813 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:27.965597 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f651cb21-b193-46f8-bbd0-064173d72813 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:27.966267 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f651cb21-b193-46f8-bbd0-064173d72813 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:27.966741 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f651cb21-b193-46f8-bbd0-064173d72813 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:27.967440 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f651cb21-b193-46f8-bbd0-064173d72813 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:27.967901 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f651cb21-b193-46f8-bbd0-064173d72813 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:27.968344 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f651cb21-b193-46f8-bbd0-064173d72813 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:28.031388 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-0e93bc8a-73c0-4f8e-bcaa-a129dd0f42ab req-175afca8-a509-40e6-8f56-f52b3cf83910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a08d7c5-4906-498e-980d-ec6d35ba8bee", "name": "network-vif-deleted", "tag": "bebfb579-fd1e-4f01-81d1-df4839bfbcc5"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:11:28.035179 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f651cb21-b193-46f8-bbd0-064173d72813 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:28.044243 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-0e93bc8a-73c0-4f8e-bcaa-a129dd0f42ab req-175afca8-a509-40e6-8f56-f52b3cf83910 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:28.044243 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-0e93bc8a-73c0-4f8e-bcaa-a129dd0f42ab req-175afca8-a509-40e6-8f56-f52b3cf83910 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:28.044243 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-0e93bc8a-73c0-4f8e-bcaa-a129dd0f42ab req-175afca8-a509-40e6-8f56-f52b3cf83910 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:28.047691 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f651cb21-b193-46f8-bbd0-064173d72813 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1391 microversion: 2.1 time: 0.093469 Sep 23 14:11:28.048356 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 460/921] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:27 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1391 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:11:28.056302 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-0e93bc8a-73c0-4f8e-bcaa-a129dd0f42ab req-175afca8-a509-40e6-8f56-f52b3cf83910 service nova] Creating event network-vif-deleted:bebfb579-fd1e-4f01-81d1-df4839bfbcc5 for instance 6a08d7c5-4906-498e-980d-ec6d35ba8bee on hv-cinder-85743 Sep 23 14:11:28.061129 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-0e93bc8a-73c0-4f8e-bcaa-a129dd0f42ab req-175afca8-a509-40e6-8f56-f52b3cf83910 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033525 Sep 23 14:11:28.062061 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 462/922] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:11:29.070945 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-50627a13-1f9c-45a3-8c1f-917c24093264 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:29.071560 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-50627a13-1f9c-45a3-8c1f-917c24093264 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:29.077503 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-50627a13-1f9c-45a3-8c1f-917c24093264 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:29.077990 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-50627a13-1f9c-45a3-8c1f-917c24093264 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:29.078456 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-50627a13-1f9c-45a3-8c1f-917c24093264 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:29.079150 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-50627a13-1f9c-45a3-8c1f-917c24093264 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:29.079606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-50627a13-1f9c-45a3-8c1f-917c24093264 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:29.080031 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-50627a13-1f9c-45a3-8c1f-917c24093264 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:29.111123 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-50627a13-1f9c-45a3-8c1f-917c24093264 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:29.111605 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-50627a13-1f9c-45a3-8c1f-917c24093264 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:29.112042 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-50627a13-1f9c-45a3-8c1f-917c24093264 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:29.112493 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-50627a13-1f9c-45a3-8c1f-917c24093264 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lazy-loading 'fault' on Instance uuid 6a08d7c5-4906-498e-980d-ec6d35ba8bee {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:11:29.152146 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-50627a13-1f9c-45a3-8c1f-917c24093264 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:29.159690 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-50627a13-1f9c-45a3-8c1f-917c24093264 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 200 len: 1230 microversion: 2.1 time: 0.092613 Sep 23 14:11:29.160259 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 461/923] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:29 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:11:30.185397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4a0ce88b-e876-4d66-8f42-27d8f1f78b03 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:30.186101 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4a0ce88b-e876-4d66-8f42-27d8f1f78b03 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 6a08d7c5-4906-498e-980d-ec6d35ba8bee] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:30.192319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a0ce88b-e876-4d66-8f42-27d8f1f78b03 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:30.193542 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a0ce88b-e876-4d66-8f42-27d8f1f78b03 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:30.193993 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a0ce88b-e876-4d66-8f42-27d8f1f78b03 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:30.194722 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a0ce88b-e876-4d66-8f42-27d8f1f78b03 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:30.195184 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a0ce88b-e876-4d66-8f42-27d8f1f78b03 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:30.195617 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4a0ce88b-e876-4d66-8f42-27d8f1f78b03 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:30.209120 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-4a0ce88b-e876-4d66-8f42-27d8f1f78b03 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] HTTP exception thrown: Instance 6a08d7c5-4906-498e-980d-ec6d35ba8bee could not be found. Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4a0ce88b-e876-4d66-8f42-27d8f1f78b03 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Request method failure captured: Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee HTTP/1.1 Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbysgeiJELVNJkMP-rxGu0ZADMYw6JuJG6drZTHfEcJElUYB8PwvreI5QH2yLVVsKpCjdnd64aImupgzgoWlReOUhEXFZN0q_DAvlK5HamoXpjdLqxBvy5aL5XVRaw9njVXh9ApVlbm041NjQxtuFRdZRYihWYNAi1QEN0_20rIaHkU Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 901178273d85449e9cdaa5de235fb3e9 Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-TestVolumeBootPattern-679432431 Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:11:30.210875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:11:30.212489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_901178273d85449e9cdaa5de235fb3e9"}]}] Sep 23 14:11:30.212489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-TestVolumeBootPattern-679432431 Sep 23 14:11:30.212489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 901178273d85449e9cdaa5de235fb3e9 Sep 23 14:11:30.212489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-TestVolumeBootPattern-679432431 Sep 23 14:11:30.212489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-TestVolumeBootPattern-679432431-project Sep 23 14:11:30.212489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:11:30.212489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:11:30.212489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 9359e90c4861470d9cc060abb9c3b203 Sep 23 14:11:30.212489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-TestVolumeBootPattern-679432431-project Sep 23 14:11:30.212489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:11:30.212489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 6a08d7c5-4906-498e-980d-ec6d35ba8bee could not be found. Sep 23 14:11:30.212489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '6a08d7c5-4906-498e-980d-ec6d35ba8bee'} Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a08d7c5-4906-498e-980d-ec6d35ba8bee could not be found. Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:11:30.213291 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a08d7c5-4906-498e-980d-ec6d35ba8bee could not be found. Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a08d7c5-4906-498e-980d-ec6d35ba8bee could not be found. Sep 23 14:11:30.214685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:30.215887 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4a0ce88b-e876-4d66-8f42-27d8f1f78b03 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Returning 404 to user: Instance 6a08d7c5-4906-498e-980d-ec6d35ba8bee could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:11:30.215887 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4a0ce88b-e876-4d66-8f42-27d8f1f78b03 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee" status: 404 len: 111 microversion: 2.1 time: 0.031904 Sep 23 14:11:30.215887 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 463/924] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:30 2022] GET /compute/v2.1/servers/6a08d7c5-4906-498e-980d-ec6d35ba8bee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:11:33.559621 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-e7f97cbb-a25e-4338-86af-4883a6deb575 req-f59570b5-1667-45d6-8b4f-08e4a270390a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817ae959-3342-4926-9f60-e4a24124a282", "tag": "c3a78cda-14d8-495c-98ba-ab806fda32b8"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:11:33.563472 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7dcbefc3-fe81-4be2-9d57-559a3bda4173 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:33.564040 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7dcbefc3-fe81-4be2-9d57-559a3bda4173 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:33.569992 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7dcbefc3-fe81-4be2-9d57-559a3bda4173 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:33.570187 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-e7f97cbb-a25e-4338-86af-4883a6deb575 req-f59570b5-1667-45d6-8b4f-08e4a270390a service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:33.570626 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7dcbefc3-fe81-4be2-9d57-559a3bda4173 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:33.570770 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-e7f97cbb-a25e-4338-86af-4883a6deb575 req-f59570b5-1667-45d6-8b4f-08e4a270390a service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:33.571062 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-e7f97cbb-a25e-4338-86af-4883a6deb575 req-f59570b5-1667-45d6-8b4f-08e4a270390a service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:33.571382 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7dcbefc3-fe81-4be2-9d57-559a3bda4173 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:33.572153 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7dcbefc3-fe81-4be2-9d57-559a3bda4173 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:33.573111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7dcbefc3-fe81-4be2-9d57-559a3bda4173 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:33.573111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7dcbefc3-fe81-4be2-9d57-559a3bda4173 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:33.584364 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-e7f97cbb-a25e-4338-86af-4883a6deb575 req-f59570b5-1667-45d6-8b4f-08e4a270390a service nova] Creating event network-changed:c3a78cda-14d8-495c-98ba-ab806fda32b8 for instance 817ae959-3342-4926-9f60-e4a24124a282 on hv-cinder-85743 Sep 23 14:11:33.589692 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-e7f97cbb-a25e-4338-86af-4883a6deb575 req-f59570b5-1667-45d6-8b4f-08e4a270390a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034158 Sep 23 14:11:33.590571 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 464/925] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:11:33.601014 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7dcbefc3-fe81-4be2-9d57-559a3bda4173 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Going to try to terminate instance {{(pid=121074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:11:33.938993 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7dcbefc3-fe81-4be2-9d57-559a3bda4173 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "DELETE /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 204 len: 0 microversion: 2.1 time: 0.379787 Sep 23 14:11:33.939768 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 462/926] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:11:33 2022] DELETE /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:11:33.950859 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4ebf3861-c576-4341-bf84-5244fc981f58 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:33.951722 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4ebf3861-c576-4341-bf84-5244fc981f58 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:33.958144 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4ebf3861-c576-4341-bf84-5244fc981f58 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:33.958544 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4ebf3861-c576-4341-bf84-5244fc981f58 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:33.959838 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4ebf3861-c576-4341-bf84-5244fc981f58 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:33.960965 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4ebf3861-c576-4341-bf84-5244fc981f58 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:33.961175 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4ebf3861-c576-4341-bf84-5244fc981f58 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:33.961737 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4ebf3861-c576-4341-bf84-5244fc981f58 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:34.109711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4ebf3861-c576-4341-bf84-5244fc981f58 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:34.117732 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4ebf3861-c576-4341-bf84-5244fc981f58 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1578 microversion: 2.1 time: 0.171292 Sep 23 14:11:34.118302 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 465/927] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:33 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:11:35.142105 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f03ae5b6-744f-403e-8db3-096c4205b0c7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:35.142830 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f03ae5b6-744f-403e-8db3-096c4205b0c7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:35.148831 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f03ae5b6-744f-403e-8db3-096c4205b0c7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:35.149316 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f03ae5b6-744f-403e-8db3-096c4205b0c7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:35.149756 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f03ae5b6-744f-403e-8db3-096c4205b0c7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:35.150475 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f03ae5b6-744f-403e-8db3-096c4205b0c7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:35.150935 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f03ae5b6-744f-403e-8db3-096c4205b0c7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:35.151362 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f03ae5b6-744f-403e-8db3-096c4205b0c7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:35.283692 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f03ae5b6-744f-403e-8db3-096c4205b0c7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:35.294483 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f03ae5b6-744f-403e-8db3-096c4205b0c7 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1578 microversion: 2.1 time: 0.156346 Sep 23 14:11:35.295281 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 463/928] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:35 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:11:36.318848 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5e53365f-db6b-4eab-8eea-ea38c8e058c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:36.319495 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5e53365f-db6b-4eab-8eea-ea38c8e058c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:36.326492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e53365f-db6b-4eab-8eea-ea38c8e058c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:36.326991 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e53365f-db6b-4eab-8eea-ea38c8e058c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:36.327453 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e53365f-db6b-4eab-8eea-ea38c8e058c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:36.328136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e53365f-db6b-4eab-8eea-ea38c8e058c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:36.328600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e53365f-db6b-4eab-8eea-ea38c8e058c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:36.329029 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5e53365f-db6b-4eab-8eea-ea38c8e058c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:36.359675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-2cb81fe3-e043-4545-9efd-06c75bf41a60 req-4c28b137-d6dd-486a-a9dc-75f3a018918e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817ae959-3342-4926-9f60-e4a24124a282", "name": "network-vif-deleted", "tag": "c3a78cda-14d8-495c-98ba-ab806fda32b8"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:11:36.369771 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-2cb81fe3-e043-4545-9efd-06c75bf41a60 req-4c28b137-d6dd-486a-a9dc-75f3a018918e service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:36.370447 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-2cb81fe3-e043-4545-9efd-06c75bf41a60 req-4c28b137-d6dd-486a-a9dc-75f3a018918e service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:36.370879 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-2cb81fe3-e043-4545-9efd-06c75bf41a60 req-4c28b137-d6dd-486a-a9dc-75f3a018918e service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:36.383271 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-2cb81fe3-e043-4545-9efd-06c75bf41a60 req-4c28b137-d6dd-486a-a9dc-75f3a018918e service nova] Creating event network-vif-deleted:c3a78cda-14d8-495c-98ba-ab806fda32b8 for instance 817ae959-3342-4926-9f60-e4a24124a282 on hv-cinder-85743 Sep 23 14:11:36.388210 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-2cb81fe3-e043-4545-9efd-06c75bf41a60 req-4c28b137-d6dd-486a-a9dc-75f3a018918e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032241 Sep 23 14:11:36.388993 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 464/929] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:11:36.403597 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5e53365f-db6b-4eab-8eea-ea38c8e058c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:36.411359 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5e53365f-db6b-4eab-8eea-ea38c8e058c4 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1392 microversion: 2.1 time: 0.096986 Sep 23 14:11:36.411952 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 466/930] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:36 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1392 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:11:37.436581 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-aea8b880-7b9e-415e-bc8b-09d4345535f3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:37.437199 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-aea8b880-7b9e-415e-bc8b-09d4345535f3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:37.443379 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aea8b880-7b9e-415e-bc8b-09d4345535f3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:37.443870 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aea8b880-7b9e-415e-bc8b-09d4345535f3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:37.444347 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aea8b880-7b9e-415e-bc8b-09d4345535f3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:37.445485 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aea8b880-7b9e-415e-bc8b-09d4345535f3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:37.445959 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aea8b880-7b9e-415e-bc8b-09d4345535f3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:37.446414 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aea8b880-7b9e-415e-bc8b-09d4345535f3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:37.479157 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aea8b880-7b9e-415e-bc8b-09d4345535f3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:37.479635 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aea8b880-7b9e-415e-bc8b-09d4345535f3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:37.480067 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-aea8b880-7b9e-415e-bc8b-09d4345535f3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:37.480509 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-aea8b880-7b9e-415e-bc8b-09d4345535f3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lazy-loading 'fault' on Instance uuid 817ae959-3342-4926-9f60-e4a24124a282 {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:11:37.526284 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-aea8b880-7b9e-415e-bc8b-09d4345535f3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9359e90c4861470d9cc060abb9c3b203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901178273d85449e9cdaa5de235fb3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:37.533959 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-aea8b880-7b9e-415e-bc8b-09d4345535f3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 200 len: 1231 microversion: 2.1 time: 0.101737 Sep 23 14:11:37.534547 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 465/931] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:37 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:11:38.558066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-303ca911-ad0c-46db-b5a5-ba81efee72c3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:38.558641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-303ca911-ad0c-46db-b5a5-ba81efee72c3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 817ae959-3342-4926-9f60-e4a24124a282] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:38.564966 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-303ca911-ad0c-46db-b5a5-ba81efee72c3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:38.565459 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-303ca911-ad0c-46db-b5a5-ba81efee72c3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:38.565893 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-303ca911-ad0c-46db-b5a5-ba81efee72c3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:38.566607 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-303ca911-ad0c-46db-b5a5-ba81efee72c3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:38.567067 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-303ca911-ad0c-46db-b5a5-ba81efee72c3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:38.567491 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-303ca911-ad0c-46db-b5a5-ba81efee72c3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:38.581276 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-303ca911-ad0c-46db-b5a5-ba81efee72c3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] HTTP exception thrown: Instance 817ae959-3342-4926-9f60-e4a24124a282 could not be found. Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-303ca911-ad0c-46db-b5a5-ba81efee72c3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Request method failure captured: Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 HTTP/1.1 Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbysgeiJELVNJkMP-rxGu0ZADMYw6JuJG6drZTHfEcJElUYB8PwvreI5QH2yLVVsKpCjdnd64aImupgzgoWlReOUhEXFZN0q_DAvlK5HamoXpjdLqxBvy5aL5XVRaw9njVXh9ApVlbm041NjQxtuFRdZRYihWYNAi1QEN0_20rIaHkU Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 901178273d85449e9cdaa5de235fb3e9 Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-TestVolumeBootPattern-679432431 Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:11:38.582916 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:11:38.584476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_901178273d85449e9cdaa5de235fb3e9"}]}] Sep 23 14:11:38.584476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-TestVolumeBootPattern-679432431 Sep 23 14:11:38.584476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 901178273d85449e9cdaa5de235fb3e9 Sep 23 14:11:38.584476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-TestVolumeBootPattern-679432431 Sep 23 14:11:38.584476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-TestVolumeBootPattern-679432431-project Sep 23 14:11:38.584476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:11:38.584476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:11:38.584476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 9359e90c4861470d9cc060abb9c3b203 Sep 23 14:11:38.584476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-TestVolumeBootPattern-679432431-project Sep 23 14:11:38.584476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:11:38.584476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 817ae959-3342-4926-9f60-e4a24124a282 could not be found. Sep 23 14:11:38.584476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '817ae959-3342-4926-9f60-e4a24124a282'} Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 817ae959-3342-4926-9f60-e4a24124a282 could not be found. Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:11:38.585397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 817ae959-3342-4926-9f60-e4a24124a282 could not be found. Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 817ae959-3342-4926-9f60-e4a24124a282 could not be found. Sep 23 14:11:38.587600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:38.589222 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-303ca911-ad0c-46db-b5a5-ba81efee72c3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Returning 404 to user: Instance 817ae959-3342-4926-9f60-e4a24124a282 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:11:38.589222 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-303ca911-ad0c-46db-b5a5-ba81efee72c3 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282" status: 404 len: 111 microversion: 2.1 time: 0.030525 Sep 23 14:11:38.589222 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 467/932] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:38 2022] GET /compute/v2.1/servers/817ae959-3342-4926-9f60-e4a24124a282 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:11:39.073718 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0f588bf1-2dfb-46d0-89f9-a5f2c1691559 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:39.074258 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-0f588bf1-2dfb-46d0-89f9-a5f2c1691559 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:39.080165 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f588bf1-2dfb-46d0-89f9-a5f2c1691559 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:39.080652 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f588bf1-2dfb-46d0-89f9-a5f2c1691559 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:39.081087 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f588bf1-2dfb-46d0-89f9-a5f2c1691559 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:39.081770 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f588bf1-2dfb-46d0-89f9-a5f2c1691559 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:39.082231 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f588bf1-2dfb-46d0-89f9-a5f2c1691559 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:39.082687 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-0f588bf1-2dfb-46d0-89f9-a5f2c1691559 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:39.096412 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-0f588bf1-2dfb-46d0-89f9-a5f2c1691559 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] HTTP exception thrown: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0f588bf1-2dfb-46d0-89f9-a5f2c1691559 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Request method failure captured: Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: DELETE /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 HTTP/1.1 Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLbysgeiJELVNJkMP-rxGu0ZADMYw6JuJG6drZTHfEcJElUYB8PwvreI5QH2yLVVsKpCjdnd64aImupgzgoWlReOUhEXFZN0q_DAvlK5HamoXpjdLqxBvy5aL5XVRaw9njVXh9ApVlbm041NjQxtuFRdZRYihWYNAi1QEN0_20rIaHkU Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 901178273d85449e9cdaa5de235fb3e9 Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-TestVolumeBootPattern-679432431 Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:11:39.098035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:11:39.099520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_901178273d85449e9cdaa5de235fb3e9"}]}] Sep 23 14:11:39.099520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-TestVolumeBootPattern-679432431 Sep 23 14:11:39.099520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 901178273d85449e9cdaa5de235fb3e9 Sep 23 14:11:39.099520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-TestVolumeBootPattern-679432431 Sep 23 14:11:39.099520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-TestVolumeBootPattern-679432431-project Sep 23 14:11:39.099520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:11:39.099520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:11:39.099520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 9359e90c4861470d9cc060abb9c3b203 Sep 23 14:11:39.099520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-TestVolumeBootPattern-679432431-project Sep 23 14:11:39.099520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:11:39.099520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:11:39.099520 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': '51a131c7-2478-421b-86df-633cca15c7b7'} Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:11:39.100279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:11:39.102429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:11:39.103871 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-0f588bf1-2dfb-46d0-89f9-a5f2c1691559 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Returning 404 to user: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:11:39.103871 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-0f588bf1-2dfb-46d0-89f9-a5f2c1691559 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "DELETE /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 404 len: 111 microversion: 2.1 time: 0.029579 Sep 23 14:11:39.103871 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 466/933] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:11:39 2022] DELETE /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:11:39.108528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c9ab3c89-2c08-4719-bcd2-4126a9c420a0 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:39.109142 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c9ab3c89-2c08-4719-bcd2-4126a9c420a0 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] [instance: 51a131c7-2478-421b-86df-633cca15c7b7] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:39.115064 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9ab3c89-2c08-4719-bcd2-4126a9c420a0 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:39.115549 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9ab3c89-2c08-4719-bcd2-4126a9c420a0 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:39.115987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9ab3c89-2c08-4719-bcd2-4126a9c420a0 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:39.116673 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9ab3c89-2c08-4719-bcd2-4126a9c420a0 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:39.117129 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9ab3c89-2c08-4719-bcd2-4126a9c420a0 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:39.117587 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9ab3c89-2c08-4719-bcd2-4126a9c420a0 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:39.130704 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-c9ab3c89-2c08-4719-bcd2-4126a9c420a0 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] HTTP exception thrown: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c9ab3c89-2c08-4719-bcd2-4126a9c420a0 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Request method failure captured: Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 HTTP/1.1 Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLbysgeiJELVNJkMP-rxGu0ZADMYw6JuJG6drZTHfEcJElUYB8PwvreI5QH2yLVVsKpCjdnd64aImupgzgoWlReOUhEXFZN0q_DAvlK5HamoXpjdLqxBvy5aL5XVRaw9njVXh9ApVlbm041NjQxtuFRdZRYihWYNAi1QEN0_20rIaHkU Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 901178273d85449e9cdaa5de235fb3e9 Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-TestVolumeBootPattern-679432431 Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:11:39.132195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:11:39.134437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/901178273d85449e9cdaa5de235fb3e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_901178273d85449e9cdaa5de235fb3e9"}]}] Sep 23 14:11:39.134437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-TestVolumeBootPattern-679432431 Sep 23 14:11:39.134437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 901178273d85449e9cdaa5de235fb3e9 Sep 23 14:11:39.134437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-TestVolumeBootPattern-679432431 Sep 23 14:11:39.134437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-TestVolumeBootPattern-679432431-project Sep 23 14:11:39.134437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:11:39.134437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:11:39.134437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 9359e90c4861470d9cc060abb9c3b203 Sep 23 14:11:39.134437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-TestVolumeBootPattern-679432431-project Sep 23 14:11:39.134437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:11:39.134437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:11:39.134437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '51a131c7-2478-421b-86df-633cca15c7b7'} Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:11:39.135356 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. Sep 23 14:11:39.136813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:11:39.138188 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c9ab3c89-2c08-4719-bcd2-4126a9c420a0 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Returning 404 to user: Instance 51a131c7-2478-421b-86df-633cca15c7b7 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:11:39.138188 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c9ab3c89-2c08-4719-bcd2-4126a9c420a0 tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7" status: 404 len: 111 microversion: 2.1 time: 0.029325 Sep 23 14:11:39.138188 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 468/934] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:39 2022] GET /compute/v2.1/servers/51a131c7-2478-421b-86df-633cca15c7b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:11:40.376564 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b67e11cc-4783-4840-a94b-e65ee358b524 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:40.377243 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b67e11cc-4783-4840-a94b-e65ee358b524 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:40.383695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b67e11cc-4783-4840-a94b-e65ee358b524 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:40.384282 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b67e11cc-4783-4840-a94b-e65ee358b524 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:40.384717 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b67e11cc-4783-4840-a94b-e65ee358b524 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:40.385402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b67e11cc-4783-4840-a94b-e65ee358b524 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:40.385847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b67e11cc-4783-4840-a94b-e65ee358b524 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:40.386263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b67e11cc-4783-4840-a94b-e65ee358b524 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:40.409472 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b67e11cc-4783-4840-a94b-e65ee358b524 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/ips" status: 200 len: 147 microversion: 2.1 time: 0.036759 Sep 23 14:11:40.410036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 467/935] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 23 14:11:40 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:11:40.663057 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3152d271-f3a4-4659-b4bd-d333e3f09f4a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] Calling method '.version_select at 0x7f9088880430>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:40.754541 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3152d271-f3a4-4659-b4bd-d333e3f09f4a tempest-TestVolumeBootPattern-679432431 tempest-TestVolumeBootPattern-679432431-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1637587475" status: 202 len: 0 microversion: 2.1 time: 0.095392 Sep 23 14:11:40.755057 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 469/936] 10.222.0.62 () {58 vars in 1263 bytes} [Fri Sep 23 14:11:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1637587475 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:11:43.172546 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8966dea5-7d9f-40db-bdeb-e610e4be1443 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5409b022-1cd0-4ad4-b924-6fd35815e349"}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:11:43.174576 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8966dea5-7d9f-40db-bdeb-e610e4be1443 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:43.180936 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8966dea5-7d9f-40db-bdeb-e610e4be1443 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:43.181470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8966dea5-7d9f-40db-bdeb-e610e4be1443 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:43.181918 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8966dea5-7d9f-40db-bdeb-e610e4be1443 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:43.182652 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8966dea5-7d9f-40db-bdeb-e610e4be1443 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:43.183317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8966dea5-7d9f-40db-bdeb-e610e4be1443 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:43.183908 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8966dea5-7d9f-40db-bdeb-e610e4be1443 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:43.879422 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8966dea5-7d9f-40db-bdeb-e610e4be1443 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "POST /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710998 Sep 23 14:11:43.880025 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 468/937] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 23 14:11:43 2022] POST /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/os-volume_attachments => generated 194 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:11:51.435626 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:11:51.436459 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:11:51.440573 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3725d35e-9600-4fa9-82bd-f550d06c0436 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:11:51.447261 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3725d35e-9600-4fa9-82bd-f550d06c0436 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:51.447746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3725d35e-9600-4fa9-82bd-f550d06c0436 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:51.448177 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3725d35e-9600-4fa9-82bd-f550d06c0436 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:51.507382 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3725d35e-9600-4fa9-82bd-f550d06c0436 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Going to try to stop instance {{(pid=121073) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 14:11:51.687973 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3725d35e-9600-4fa9-82bd-f550d06c0436 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "POST /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/action" status: 202 len: 0 microversion: 2.1 time: 0.253501 Sep 23 14:11:51.688487 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 470/938] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 23 14:11:51 2022] POST /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:11:51.698213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-54198e3e-3a17-4256-bfbf-7f528771bdfb tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:51.699514 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-54198e3e-3a17-4256-bfbf-7f528771bdfb tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:51.705831 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54198e3e-3a17-4256-bfbf-7f528771bdfb tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:51.706350 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54198e3e-3a17-4256-bfbf-7f528771bdfb tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:51.706815 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54198e3e-3a17-4256-bfbf-7f528771bdfb tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:51.707804 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54198e3e-3a17-4256-bfbf-7f528771bdfb tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:51.708088 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54198e3e-3a17-4256-bfbf-7f528771bdfb tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:51.708519 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-54198e3e-3a17-4256-bfbf-7f528771bdfb tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:51.840516 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-54198e3e-3a17-4256-bfbf-7f528771bdfb tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:51.848669 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-54198e3e-3a17-4256-bfbf-7f528771bdfb tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1724 microversion: 2.1 time: 0.155464 Sep 23 14:11:51.849227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 469/939] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:51 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:11:52.873073 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1907516a-635b-40aa-99e5-f313e055de31 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:52.873807 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1907516a-635b-40aa-99e5-f313e055de31 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:52.880526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1907516a-635b-40aa-99e5-f313e055de31 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:52.881014 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1907516a-635b-40aa-99e5-f313e055de31 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:52.881455 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1907516a-635b-40aa-99e5-f313e055de31 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:52.882141 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1907516a-635b-40aa-99e5-f313e055de31 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:52.882631 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1907516a-635b-40aa-99e5-f313e055de31 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:52.883061 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1907516a-635b-40aa-99e5-f313e055de31 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:53.010705 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1907516a-635b-40aa-99e5-f313e055de31 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:53.019505 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1907516a-635b-40aa-99e5-f313e055de31 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1724 microversion: 2.1 time: 0.151852 Sep 23 14:11:53.020066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 471/940] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:52 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:11:54.044055 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-efc6faae-7724-4325-a10c-455cd97e1676 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:54.044672 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-efc6faae-7724-4325-a10c-455cd97e1676 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:54.051341 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-efc6faae-7724-4325-a10c-455cd97e1676 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:54.051825 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-efc6faae-7724-4325-a10c-455cd97e1676 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:54.052262 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-efc6faae-7724-4325-a10c-455cd97e1676 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:54.052944 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-efc6faae-7724-4325-a10c-455cd97e1676 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:54.053398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-efc6faae-7724-4325-a10c-455cd97e1676 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:54.053815 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-efc6faae-7724-4325-a10c-455cd97e1676 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:54.186067 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-efc6faae-7724-4325-a10c-455cd97e1676 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:54.194244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-efc6faae-7724-4325-a10c-455cd97e1676 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1724 microversion: 2.1 time: 0.155173 Sep 23 14:11:54.194839 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 470/941] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:54 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:11:55.216956 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-bcb52ef5-e195-4cd6-a97d-31ca0682938d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:55.217640 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-bcb52ef5-e195-4cd6-a97d-31ca0682938d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:55.224107 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bcb52ef5-e195-4cd6-a97d-31ca0682938d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:55.224595 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bcb52ef5-e195-4cd6-a97d-31ca0682938d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:55.225030 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bcb52ef5-e195-4cd6-a97d-31ca0682938d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:55.225719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bcb52ef5-e195-4cd6-a97d-31ca0682938d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:55.226175 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bcb52ef5-e195-4cd6-a97d-31ca0682938d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:55.226631 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bcb52ef5-e195-4cd6-a97d-31ca0682938d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:55.354122 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-bcb52ef5-e195-4cd6-a97d-31ca0682938d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:55.362919 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-bcb52ef5-e195-4cd6-a97d-31ca0682938d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1724 microversion: 2.1 time: 0.149822 Sep 23 14:11:55.363476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 472/942] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:55 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:11:56.387314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-29382a9b-8940-4374-a67d-a521d62119f4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:56.387936 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-29382a9b-8940-4374-a67d-a521d62119f4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:56.394087 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-29382a9b-8940-4374-a67d-a521d62119f4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:56.394594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-29382a9b-8940-4374-a67d-a521d62119f4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:56.395028 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-29382a9b-8940-4374-a67d-a521d62119f4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:56.395704 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-29382a9b-8940-4374-a67d-a521d62119f4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:56.396155 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-29382a9b-8940-4374-a67d-a521d62119f4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:56.396574 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-29382a9b-8940-4374-a67d-a521d62119f4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:56.399180 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:11:56.529595 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-29382a9b-8940-4374-a67d-a521d62119f4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:56.537772 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-29382a9b-8940-4374-a67d-a521d62119f4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1724 microversion: 2.1 time: 0.155052 Sep 23 14:11:56.538349 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 471/943] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:56 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:11:57.561261 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d9649048-f84f-444a-b0b4-c12106253b76 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:57.561871 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d9649048-f84f-444a-b0b4-c12106253b76 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:57.568168 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9649048-f84f-444a-b0b4-c12106253b76 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:57.568646 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9649048-f84f-444a-b0b4-c12106253b76 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:57.569079 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9649048-f84f-444a-b0b4-c12106253b76 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:57.569761 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9649048-f84f-444a-b0b4-c12106253b76 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:57.570214 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9649048-f84f-444a-b0b4-c12106253b76 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:57.570668 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d9649048-f84f-444a-b0b4-c12106253b76 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:57.700463 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d9649048-f84f-444a-b0b4-c12106253b76 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:57.708690 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d9649048-f84f-444a-b0b4-c12106253b76 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1724 microversion: 2.1 time: 0.151392 Sep 23 14:11:57.711492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 473/944] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:57 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:11:58.731988 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5d67709f-1839-448a-b106-7860e15baeaa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:58.732646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-5d67709f-1839-448a-b106-7860e15baeaa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:58.734946 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:11:58.739579 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d67709f-1839-448a-b106-7860e15baeaa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:58.740039 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d67709f-1839-448a-b106-7860e15baeaa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:58.740469 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d67709f-1839-448a-b106-7860e15baeaa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:58.741149 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d67709f-1839-448a-b106-7860e15baeaa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:58.741601 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d67709f-1839-448a-b106-7860e15baeaa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:58.742025 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5d67709f-1839-448a-b106-7860e15baeaa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:58.868706 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5d67709f-1839-448a-b106-7860e15baeaa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:11:58.877565 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5d67709f-1839-448a-b106-7860e15baeaa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1724 microversion: 2.1 time: 0.150024 Sep 23 14:11:58.878129 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 472/945] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:58 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:11:59.900395 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-7449028c-4437-4c82-b60e-5fda2ba9e1fc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:11:59.900958 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-7449028c-4437-4c82-b60e-5fda2ba9e1fc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:11:59.907371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7449028c-4437-4c82-b60e-5fda2ba9e1fc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:59.907858 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7449028c-4437-4c82-b60e-5fda2ba9e1fc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:59.908300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7449028c-4437-4c82-b60e-5fda2ba9e1fc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:11:59.908994 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7449028c-4437-4c82-b60e-5fda2ba9e1fc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:11:59.909450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7449028c-4437-4c82-b60e-5fda2ba9e1fc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:11:59.909876 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-7449028c-4437-4c82-b60e-5fda2ba9e1fc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:00.041608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-7449028c-4437-4c82-b60e-5fda2ba9e1fc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:00.050456 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-7449028c-4437-4c82-b60e-5fda2ba9e1fc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1724 microversion: 2.1 time: 0.154128 Sep 23 14:12:00.051004 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 474/946] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:11:59 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:01.075099 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-3f5f8c69-3dff-453f-96fd-13c43e133426 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:01.075819 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-3f5f8c69-3dff-453f-96fd-13c43e133426 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:01.081975 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f5f8c69-3dff-453f-96fd-13c43e133426 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:01.082491 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f5f8c69-3dff-453f-96fd-13c43e133426 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:01.082931 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f5f8c69-3dff-453f-96fd-13c43e133426 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:01.083617 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f5f8c69-3dff-453f-96fd-13c43e133426 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:01.084076 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f5f8c69-3dff-453f-96fd-13c43e133426 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:01.084502 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3f5f8c69-3dff-453f-96fd-13c43e133426 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:01.214197 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-3f5f8c69-3dff-453f-96fd-13c43e133426 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:01.222754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-3f5f8c69-3dff-453f-96fd-13c43e133426 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1724 microversion: 2.1 time: 0.152355 Sep 23 14:12:01.223315 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 473/947] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:01 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:02.244687 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9dd31d7c-e843-4473-a91e-ac679d88236c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:02.245296 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9dd31d7c-e843-4473-a91e-ac679d88236c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:02.252274 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9dd31d7c-e843-4473-a91e-ac679d88236c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:02.252754 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9dd31d7c-e843-4473-a91e-ac679d88236c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:02.253184 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9dd31d7c-e843-4473-a91e-ac679d88236c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:02.253864 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9dd31d7c-e843-4473-a91e-ac679d88236c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:02.254315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9dd31d7c-e843-4473-a91e-ac679d88236c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:02.254761 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9dd31d7c-e843-4473-a91e-ac679d88236c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:02.384663 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9dd31d7c-e843-4473-a91e-ac679d88236c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:02.393222 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9dd31d7c-e843-4473-a91e-ac679d88236c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1724 microversion: 2.1 time: 0.152308 Sep 23 14:12:02.393798 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 475/948] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:02 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:03.416119 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b2a47729-b8c2-438e-bdb1-807458819e98 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:03.416784 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b2a47729-b8c2-438e-bdb1-807458819e98 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:03.423298 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b2a47729-b8c2-438e-bdb1-807458819e98 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:03.423782 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b2a47729-b8c2-438e-bdb1-807458819e98 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:03.424217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b2a47729-b8c2-438e-bdb1-807458819e98 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:03.424898 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b2a47729-b8c2-438e-bdb1-807458819e98 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:03.425350 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b2a47729-b8c2-438e-bdb1-807458819e98 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:03.425770 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b2a47729-b8c2-438e-bdb1-807458819e98 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:03.551027 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b2a47729-b8c2-438e-bdb1-807458819e98 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:03.560445 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b2a47729-b8c2-438e-bdb1-807458819e98 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1724 microversion: 2.1 time: 0.148191 Sep 23 14:12:03.561020 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 474/949] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:03 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:04.584527 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b8521a02-777e-46a7-8251-3066a194ffab tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:04.585147 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b8521a02-777e-46a7-8251-3066a194ffab tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:04.592904 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b8521a02-777e-46a7-8251-3066a194ffab tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:04.593396 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b8521a02-777e-46a7-8251-3066a194ffab tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:04.593839 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b8521a02-777e-46a7-8251-3066a194ffab tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:04.594561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b8521a02-777e-46a7-8251-3066a194ffab tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:04.595028 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b8521a02-777e-46a7-8251-3066a194ffab tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:04.595461 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b8521a02-777e-46a7-8251-3066a194ffab tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:04.725430 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-b8521a02-777e-46a7-8251-3066a194ffab tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:04.733863 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b8521a02-777e-46a7-8251-3066a194ffab tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1724 microversion: 2.1 time: 0.153491 Sep 23 14:12:04.734471 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 476/950] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:04 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:05.756978 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-31026371-bf3f-4c70-acdd-c94e4ece770d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:05.757624 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-31026371-bf3f-4c70-acdd-c94e4ece770d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:05.764046 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-31026371-bf3f-4c70-acdd-c94e4ece770d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:05.764536 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-31026371-bf3f-4c70-acdd-c94e4ece770d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:05.764972 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-31026371-bf3f-4c70-acdd-c94e4ece770d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:05.765662 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-31026371-bf3f-4c70-acdd-c94e4ece770d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:05.766118 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-31026371-bf3f-4c70-acdd-c94e4ece770d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:05.766595 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-31026371-bf3f-4c70-acdd-c94e4ece770d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:05.896731 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-31026371-bf3f-4c70-acdd-c94e4ece770d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:05.905504 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-31026371-bf3f-4c70-acdd-c94e4ece770d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1724 microversion: 2.1 time: 0.152400 Sep 23 14:12:05.906062 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 475/951] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:05 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:06.929534 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c9ad268e-e054-4eaa-a570-a6d00d077253 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:06.930153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c9ad268e-e054-4eaa-a570-a6d00d077253 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:06.936863 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9ad268e-e054-4eaa-a570-a6d00d077253 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:06.937349 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9ad268e-e054-4eaa-a570-a6d00d077253 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:06.937787 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9ad268e-e054-4eaa-a570-a6d00d077253 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:06.938504 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9ad268e-e054-4eaa-a570-a6d00d077253 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:06.938965 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9ad268e-e054-4eaa-a570-a6d00d077253 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:06.939391 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9ad268e-e054-4eaa-a570-a6d00d077253 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:07.064280 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c9ad268e-e054-4eaa-a570-a6d00d077253 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:07.072371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c9ad268e-e054-4eaa-a570-a6d00d077253 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1724 microversion: 2.1 time: 0.147190 Sep 23 14:12:07.072935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 477/952] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:06 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:08.095499 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-af3ba22d-0924-471f-aae4-f8b030272680 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:08.096127 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-af3ba22d-0924-471f-aae4-f8b030272680 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:08.102487 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-af3ba22d-0924-471f-aae4-f8b030272680 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:08.102996 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-af3ba22d-0924-471f-aae4-f8b030272680 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:08.103428 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-af3ba22d-0924-471f-aae4-f8b030272680 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:08.104103 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-af3ba22d-0924-471f-aae4-f8b030272680 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:08.104557 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-af3ba22d-0924-471f-aae4-f8b030272680 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:08.104975 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-af3ba22d-0924-471f-aae4-f8b030272680 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:08.235874 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-af3ba22d-0924-471f-aae4-f8b030272680 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:08.243973 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-af3ba22d-0924-471f-aae4-f8b030272680 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1701 microversion: 2.1 time: 0.152234 Sep 23 14:12:08.244532 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 476/953] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:08 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:08.267261 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e9df5bcc-3cf7-4e39-b6ed-55df31fddc9f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:12:08.273578 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9df5bcc-3cf7-4e39-b6ed-55df31fddc9f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:08.274060 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9df5bcc-3cf7-4e39-b6ed-55df31fddc9f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:08.274542 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e9df5bcc-3cf7-4e39-b6ed-55df31fddc9f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:08.297580 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e9df5bcc-3cf7-4e39-b6ed-55df31fddc9f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Going to try to start instance {{(pid=121073) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 14:12:08.458743 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e9df5bcc-3cf7-4e39-b6ed-55df31fddc9f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "POST /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/action" status: 202 len: 0 microversion: 2.1 time: 0.195035 Sep 23 14:12:08.459354 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 478/954] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 23 14:12:08 2022] POST /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:12:08.470262 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-816ca7c6-07cc-4217-88e9-db9b0d017673 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:08.471243 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-816ca7c6-07cc-4217-88e9-db9b0d017673 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:08.476723 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-816ca7c6-07cc-4217-88e9-db9b0d017673 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:08.477217 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-816ca7c6-07cc-4217-88e9-db9b0d017673 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:08.477655 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-816ca7c6-07cc-4217-88e9-db9b0d017673 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:08.478363 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-816ca7c6-07cc-4217-88e9-db9b0d017673 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:08.478821 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-816ca7c6-07cc-4217-88e9-db9b0d017673 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:08.479247 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-816ca7c6-07cc-4217-88e9-db9b0d017673 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:08.609567 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-816ca7c6-07cc-4217-88e9-db9b0d017673 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:08.617688 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-816ca7c6-07cc-4217-88e9-db9b0d017673 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1710 microversion: 2.1 time: 0.151316 Sep 23 14:12:08.618250 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 477/955] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:08 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:09.642306 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-0c901c23-16e0-4656-a381-878b22405f9b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:09.643020 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-0c901c23-16e0-4656-a381-878b22405f9b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:09.649052 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0c901c23-16e0-4656-a381-878b22405f9b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:09.649528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0c901c23-16e0-4656-a381-878b22405f9b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:09.649958 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0c901c23-16e0-4656-a381-878b22405f9b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:09.650666 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0c901c23-16e0-4656-a381-878b22405f9b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:09.651118 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0c901c23-16e0-4656-a381-878b22405f9b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:09.651540 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0c901c23-16e0-4656-a381-878b22405f9b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:09.993136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-0c901c23-16e0-4656-a381-878b22405f9b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:10.001314 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-0c901c23-16e0-4656-a381-878b22405f9b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1710 microversion: 2.1 time: 0.363723 Sep 23 14:12:10.001884 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 479/956] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:09 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1710 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:11.024894 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1b781874-eae1-47eb-816f-4b7882a9e38e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:11.025506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1b781874-eae1-47eb-816f-4b7882a9e38e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:11.032717 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b781874-eae1-47eb-816f-4b7882a9e38e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:11.033208 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b781874-eae1-47eb-816f-4b7882a9e38e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:11.033647 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b781874-eae1-47eb-816f-4b7882a9e38e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:11.034374 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b781874-eae1-47eb-816f-4b7882a9e38e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:11.034833 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b781874-eae1-47eb-816f-4b7882a9e38e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:11.035260 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1b781874-eae1-47eb-816f-4b7882a9e38e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:11.220700 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-1b781874-eae1-47eb-816f-4b7882a9e38e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:11.228741 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1b781874-eae1-47eb-816f-4b7882a9e38e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1714 microversion: 2.1 time: 0.207786 Sep 23 14:12:11.229304 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 478/957] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:11 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1714 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:12:44.135153 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3c31b138-5ef2-4baa-96b4-1366038725a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:44.135762 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3c31b138-5ef2-4baa-96b4-1366038725a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:44.137909 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=20 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:12:44.138582 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:12:44.143815 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c31b138-5ef2-4baa-96b4-1366038725a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:44.144299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c31b138-5ef2-4baa-96b4-1366038725a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:44.144733 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c31b138-5ef2-4baa-96b4-1366038725a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:44.145416 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c31b138-5ef2-4baa-96b4-1366038725a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:44.145867 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c31b138-5ef2-4baa-96b4-1366038725a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:44.146284 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c31b138-5ef2-4baa-96b4-1366038725a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:44.227609 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-3c31b138-5ef2-4baa-96b4-1366038725a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lazy-loading 'services' on Instance uuid 13eef24f-a406-4677-9362-460ce72549d8 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:12:44.536377 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3c31b138-5ef2-4baa-96b4-1366038725a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "DELETE /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/os-volume_attachments/5409b022-1cd0-4ad4-b924-6fd35815e349" status: 202 len: 0 microversion: 2.1 time: 0.404919 Sep 23 14:12:44.536990 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 480/958] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 23 14:12:44 2022] DELETE /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/os-volume_attachments/5409b022-1cd0-4ad4-b924-6fd35815e349 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:12:46.717758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b5c79008-a381-49b7-bed1-a4f9177f727d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:12:46.721107 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 14:12:46.724207 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Fri Sep 23 14:12:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/action (ip 10.222.0.62) !!! Sep 23 14:12:46.724207 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=13 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:12:46.724207 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=47 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:12:46.728815 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b5c79008-a381-49b7-bed1-a4f9177f727d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:46.729303 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b5c79008-a381-49b7-bed1-a4f9177f727d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:46.729740 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b5c79008-a381-49b7-bed1-a4f9177f727d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:46.790929 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b5c79008-a381-49b7-bed1-a4f9177f727d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Going to try to stop instance {{(pid=121074) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 14:12:46.996055 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b5c79008-a381-49b7-bed1-a4f9177f727d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "POST /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/action" status: 202 len: 0 microversion: 2.1 time: 0.281974 Sep 23 14:12:46.996707 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 479/959] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 23 14:12:46 2022] POST /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:12:47.007043 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-281cde1f-419d-4c47-867b-9b14a9932de2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:47.007749 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-281cde1f-419d-4c47-867b-9b14a9932de2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:47.014211 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-281cde1f-419d-4c47-867b-9b14a9932de2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:47.014746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-281cde1f-419d-4c47-867b-9b14a9932de2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:47.015171 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-281cde1f-419d-4c47-867b-9b14a9932de2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:47.015869 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-281cde1f-419d-4c47-867b-9b14a9932de2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:47.016326 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-281cde1f-419d-4c47-867b-9b14a9932de2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:47.016758 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-281cde1f-419d-4c47-867b-9b14a9932de2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:47.151549 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-281cde1f-419d-4c47-867b-9b14a9932de2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:47.159358 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-281cde1f-419d-4c47-867b-9b14a9932de2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1678 microversion: 2.1 time: 0.158300 Sep 23 14:12:47.159923 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 481/960] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:46 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:48.183606 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-828761f9-70fc-4f10-a466-ed3af9207f71 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:48.184294 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-828761f9-70fc-4f10-a466-ed3af9207f71 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:48.190976 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-828761f9-70fc-4f10-a466-ed3af9207f71 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:48.191457 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-828761f9-70fc-4f10-a466-ed3af9207f71 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:48.191889 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-828761f9-70fc-4f10-a466-ed3af9207f71 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:48.192569 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-828761f9-70fc-4f10-a466-ed3af9207f71 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:48.193025 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-828761f9-70fc-4f10-a466-ed3af9207f71 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:48.193445 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-828761f9-70fc-4f10-a466-ed3af9207f71 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:48.324351 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-828761f9-70fc-4f10-a466-ed3af9207f71 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:48.332821 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-828761f9-70fc-4f10-a466-ed3af9207f71 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1678 microversion: 2.1 time: 0.153286 Sep 23 14:12:48.333314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 480/961] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:48 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:49.355925 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9cfa7e94-b5fb-46d2-96b2-5f8a979d8631 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:49.356566 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9cfa7e94-b5fb-46d2-96b2-5f8a979d8631 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:49.363832 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9cfa7e94-b5fb-46d2-96b2-5f8a979d8631 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:49.364320 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9cfa7e94-b5fb-46d2-96b2-5f8a979d8631 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:49.364758 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9cfa7e94-b5fb-46d2-96b2-5f8a979d8631 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:49.365443 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9cfa7e94-b5fb-46d2-96b2-5f8a979d8631 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:49.365901 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9cfa7e94-b5fb-46d2-96b2-5f8a979d8631 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:49.366349 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9cfa7e94-b5fb-46d2-96b2-5f8a979d8631 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:49.494200 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9cfa7e94-b5fb-46d2-96b2-5f8a979d8631 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:49.502563 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9cfa7e94-b5fb-46d2-96b2-5f8a979d8631 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1678 microversion: 2.1 time: 0.150513 Sep 23 14:12:49.503136 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 482/962] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:49 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:12:50.525875 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7ab13feb-0800-40b2-ae78-4d56d5706412 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:50.526518 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7ab13feb-0800-40b2-ae78-4d56d5706412 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:50.533648 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ab13feb-0800-40b2-ae78-4d56d5706412 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:50.534124 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ab13feb-0800-40b2-ae78-4d56d5706412 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:50.534585 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ab13feb-0800-40b2-ae78-4d56d5706412 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:50.535261 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ab13feb-0800-40b2-ae78-4d56d5706412 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:50.535712 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ab13feb-0800-40b2-ae78-4d56d5706412 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:50.536133 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ab13feb-0800-40b2-ae78-4d56d5706412 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:50.669670 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7ab13feb-0800-40b2-ae78-4d56d5706412 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:50.678210 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7ab13feb-0800-40b2-ae78-4d56d5706412 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1678 microversion: 2.1 time: 0.156153 Sep 23 14:12:50.678804 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 481/963] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:50 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:51.701864 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ebc6c2d0-908a-4636-94b2-baeef39d61c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:51.702427 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ebc6c2d0-908a-4636-94b2-baeef39d61c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:51.708834 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ebc6c2d0-908a-4636-94b2-baeef39d61c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:51.709315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ebc6c2d0-908a-4636-94b2-baeef39d61c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:51.709755 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ebc6c2d0-908a-4636-94b2-baeef39d61c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:51.710467 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ebc6c2d0-908a-4636-94b2-baeef39d61c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:51.710927 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ebc6c2d0-908a-4636-94b2-baeef39d61c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:51.711352 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ebc6c2d0-908a-4636-94b2-baeef39d61c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:51.837558 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ebc6c2d0-908a-4636-94b2-baeef39d61c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:51.845845 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ebc6c2d0-908a-4636-94b2-baeef39d61c1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1678 microversion: 2.1 time: 0.147338 Sep 23 14:12:51.846427 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 483/964] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:51 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:52.868671 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6814b9b4-f71b-44d7-a2f3-7b1ab3b9e989 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:52.876615 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6814b9b4-f71b-44d7-a2f3-7b1ab3b9e989 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:52.876615 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6814b9b4-f71b-44d7-a2f3-7b1ab3b9e989 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:52.876615 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6814b9b4-f71b-44d7-a2f3-7b1ab3b9e989 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:52.876999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6814b9b4-f71b-44d7-a2f3-7b1ab3b9e989 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:52.877718 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6814b9b4-f71b-44d7-a2f3-7b1ab3b9e989 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:52.878176 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6814b9b4-f71b-44d7-a2f3-7b1ab3b9e989 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:52.878625 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6814b9b4-f71b-44d7-a2f3-7b1ab3b9e989 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:53.009242 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6814b9b4-f71b-44d7-a2f3-7b1ab3b9e989 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:53.017507 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6814b9b4-f71b-44d7-a2f3-7b1ab3b9e989 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1678 microversion: 2.1 time: 0.152239 Sep 23 14:12:53.018081 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 482/965] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:52 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:54.040947 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5512739e-b9e3-422d-bb51-2a3284f8969a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:54.041556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5512739e-b9e3-422d-bb51-2a3284f8969a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:54.048617 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5512739e-b9e3-422d-bb51-2a3284f8969a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:54.049111 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5512739e-b9e3-422d-bb51-2a3284f8969a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:54.049550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5512739e-b9e3-422d-bb51-2a3284f8969a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:54.050233 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5512739e-b9e3-422d-bb51-2a3284f8969a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:54.050715 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5512739e-b9e3-422d-bb51-2a3284f8969a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:54.051141 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5512739e-b9e3-422d-bb51-2a3284f8969a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:54.176493 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5512739e-b9e3-422d-bb51-2a3284f8969a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:54.184525 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5512739e-b9e3-422d-bb51-2a3284f8969a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1678 microversion: 2.1 time: 0.147381 Sep 23 14:12:54.185090 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 484/966] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:54 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:55.209024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-38ddcdb9-eea8-4c03-9198-d520e3a2bc03 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:55.209640 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-38ddcdb9-eea8-4c03-9198-d520e3a2bc03 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:55.216231 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-38ddcdb9-eea8-4c03-9198-d520e3a2bc03 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:55.216765 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-38ddcdb9-eea8-4c03-9198-d520e3a2bc03 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:55.217159 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-38ddcdb9-eea8-4c03-9198-d520e3a2bc03 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:55.217854 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-38ddcdb9-eea8-4c03-9198-d520e3a2bc03 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:55.218310 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-38ddcdb9-eea8-4c03-9198-d520e3a2bc03 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:55.218756 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-38ddcdb9-eea8-4c03-9198-d520e3a2bc03 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:55.345666 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-38ddcdb9-eea8-4c03-9198-d520e3a2bc03 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:55.353380 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-38ddcdb9-eea8-4c03-9198-d520e3a2bc03 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1678 microversion: 2.1 time: 0.148907 Sep 23 14:12:55.353955 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 483/967] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:55 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:56.377764 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d611b45b-031d-4b44-a6a7-cf246b93c737 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:56.378350 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d611b45b-031d-4b44-a6a7-cf246b93c737 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:56.384712 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d611b45b-031d-4b44-a6a7-cf246b93c737 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:56.385199 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d611b45b-031d-4b44-a6a7-cf246b93c737 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:56.385637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d611b45b-031d-4b44-a6a7-cf246b93c737 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:56.386350 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d611b45b-031d-4b44-a6a7-cf246b93c737 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:56.386815 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d611b45b-031d-4b44-a6a7-cf246b93c737 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:56.387242 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d611b45b-031d-4b44-a6a7-cf246b93c737 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:56.519345 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d611b45b-031d-4b44-a6a7-cf246b93c737 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:56.526965 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d611b45b-031d-4b44-a6a7-cf246b93c737 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1678 microversion: 2.1 time: 0.153818 Sep 23 14:12:56.527526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 485/968] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:56 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:57.553024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-29b4ead5-6f05-4209-8393-03dcf4e29754 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:57.553573 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-29b4ead5-6f05-4209-8393-03dcf4e29754 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:57.560055 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-29b4ead5-6f05-4209-8393-03dcf4e29754 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:57.560537 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-29b4ead5-6f05-4209-8393-03dcf4e29754 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:57.560973 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-29b4ead5-6f05-4209-8393-03dcf4e29754 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:57.561663 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-29b4ead5-6f05-4209-8393-03dcf4e29754 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:57.562118 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-29b4ead5-6f05-4209-8393-03dcf4e29754 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:57.562574 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-29b4ead5-6f05-4209-8393-03dcf4e29754 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:57.695524 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-29b4ead5-6f05-4209-8393-03dcf4e29754 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:57.703772 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-29b4ead5-6f05-4209-8393-03dcf4e29754 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1678 microversion: 2.1 time: 0.157038 Sep 23 14:12:57.705234 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 484/969] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:57 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:58.729837 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-78a4fa16-a346-4e9e-85ba-86abf780c57d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:58.761868 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-78a4fa16-a346-4e9e-85ba-86abf780c57d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:58.761868 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-78a4fa16-a346-4e9e-85ba-86abf780c57d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:58.761868 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-78a4fa16-a346-4e9e-85ba-86abf780c57d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:58.761868 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-78a4fa16-a346-4e9e-85ba-86abf780c57d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:58.762289 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-78a4fa16-a346-4e9e-85ba-86abf780c57d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:58.762289 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-78a4fa16-a346-4e9e-85ba-86abf780c57d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:58.762289 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-78a4fa16-a346-4e9e-85ba-86abf780c57d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:58.870662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-78a4fa16-a346-4e9e-85ba-86abf780c57d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:58.876477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-78a4fa16-a346-4e9e-85ba-86abf780c57d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1655 microversion: 2.1 time: 0.150478 Sep 23 14:12:58.877038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 486/970] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:58 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:12:58.905941 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-2909040d-48e4-4159-9cd6-0079d2c2e55e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:12:58.913016 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2909040d-48e4-4159-9cd6-0079d2c2e55e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:58.913515 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2909040d-48e4-4159-9cd6-0079d2c2e55e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:58.913963 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2909040d-48e4-4159-9cd6-0079d2c2e55e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:58.938035 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-2909040d-48e4-4159-9cd6-0079d2c2e55e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Going to try to start instance {{(pid=121074) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 14:12:59.086784 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-2909040d-48e4-4159-9cd6-0079d2c2e55e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "POST /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/action" status: 202 len: 0 microversion: 2.1 time: 0.184406 Sep 23 14:12:59.087376 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 485/971] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 23 14:12:58 2022] POST /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:12:59.097268 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-70c116b5-42cb-42c4-bc18-753bb5f1efb2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:12:59.097923 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-70c116b5-42cb-42c4-bc18-753bb5f1efb2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:12:59.104551 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70c116b5-42cb-42c4-bc18-753bb5f1efb2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:59.105047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70c116b5-42cb-42c4-bc18-753bb5f1efb2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:59.105487 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70c116b5-42cb-42c4-bc18-753bb5f1efb2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:59.106181 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70c116b5-42cb-42c4-bc18-753bb5f1efb2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:12:59.106662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70c116b5-42cb-42c4-bc18-753bb5f1efb2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:12:59.107090 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-70c116b5-42cb-42c4-bc18-753bb5f1efb2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:12:59.237314 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-70c116b5-42cb-42c4-bc18-753bb5f1efb2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:12:59.245119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-70c116b5-42cb-42c4-bc18-753bb5f1efb2 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1664 microversion: 2.1 time: 0.153458 Sep 23 14:12:59.245689 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 487/972] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:12:59 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:00.269917 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6de90fd5-53f2-444d-bf43-02a2209835fd tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:00.270651 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6de90fd5-53f2-444d-bf43-02a2209835fd tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:00.276836 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6de90fd5-53f2-444d-bf43-02a2209835fd tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:00.277275 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6de90fd5-53f2-444d-bf43-02a2209835fd tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:00.277719 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6de90fd5-53f2-444d-bf43-02a2209835fd tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:00.278451 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6de90fd5-53f2-444d-bf43-02a2209835fd tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:00.278912 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6de90fd5-53f2-444d-bf43-02a2209835fd tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:00.279342 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6de90fd5-53f2-444d-bf43-02a2209835fd tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:00.409386 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6de90fd5-53f2-444d-bf43-02a2209835fd tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:00.416972 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6de90fd5-53f2-444d-bf43-02a2209835fd tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1664 microversion: 2.1 time: 0.151845 Sep 23 14:13:00.417536 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 486/973] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:00 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:01.440756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3e95ebb8-a485-4481-bc2f-0f72f260bbb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:01.441369 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3e95ebb8-a485-4481-bc2f-0f72f260bbb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:01.447664 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e95ebb8-a485-4481-bc2f-0f72f260bbb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:01.448147 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e95ebb8-a485-4481-bc2f-0f72f260bbb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:01.448579 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e95ebb8-a485-4481-bc2f-0f72f260bbb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:01.449265 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e95ebb8-a485-4481-bc2f-0f72f260bbb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:01.449719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e95ebb8-a485-4481-bc2f-0f72f260bbb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:01.450141 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3e95ebb8-a485-4481-bc2f-0f72f260bbb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:01.578582 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3e95ebb8-a485-4481-bc2f-0f72f260bbb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:01.586724 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3e95ebb8-a485-4481-bc2f-0f72f260bbb6 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1668 microversion: 2.1 time: 0.150178 Sep 23 14:13:01.587284 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 488/974] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:01 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:34.398032 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-936c4371-e63d-4e20-a42d-176c70d0b528 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:34.400293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-936c4371-e63d-4e20-a42d-176c70d0b528 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:34.402844 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=16 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:13:34.403497 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:13:34.408188 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-936c4371-e63d-4e20-a42d-176c70d0b528 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:34.408674 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-936c4371-e63d-4e20-a42d-176c70d0b528 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:34.409113 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-936c4371-e63d-4e20-a42d-176c70d0b528 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:34.409805 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-936c4371-e63d-4e20-a42d-176c70d0b528 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:34.410260 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-936c4371-e63d-4e20-a42d-176c70d0b528 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:34.410721 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-936c4371-e63d-4e20-a42d-176c70d0b528 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:34.441577 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-936c4371-e63d-4e20-a42d-176c70d0b528 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046814 Sep 23 14:13:34.442149 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 487/975] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:13:34 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 14:13:34.505271 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e82e1eeb-d501-4e3c-b9d5-6bdf304f7840 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:34.505790 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e82e1eeb-d501-4e3c-b9d5-6bdf304f7840 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:34.508119 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=18 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:13:34.508867 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:13:34.513417 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e82e1eeb-d501-4e3c-b9d5-6bdf304f7840 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:34.513911 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e82e1eeb-d501-4e3c-b9d5-6bdf304f7840 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:34.514379 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e82e1eeb-d501-4e3c-b9d5-6bdf304f7840 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:34.515090 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e82e1eeb-d501-4e3c-b9d5-6bdf304f7840 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:34.515592 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e82e1eeb-d501-4e3c-b9d5-6bdf304f7840 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:34.516020 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e82e1eeb-d501-4e3c-b9d5-6bdf304f7840 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:34.542031 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e82e1eeb-d501-4e3c-b9d5-6bdf304f7840 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Going to try to terminate instance {{(pid=121073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:13:34.830926 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e82e1eeb-d501-4e3c-b9d5-6bdf304f7840 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "DELETE /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 204 len: 0 microversion: 2.1 time: 0.330201 Sep 23 14:13:34.831668 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 489/976] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:13:34 2022] DELETE /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:13:34.839653 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-69e7f374-0a72-4f60-85b1-1d9a8c975dc4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:34.843421 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-69e7f374-0a72-4f60-85b1-1d9a8c975dc4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:34.846833 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-69e7f374-0a72-4f60-85b1-1d9a8c975dc4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:34.847813 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-69e7f374-0a72-4f60-85b1-1d9a8c975dc4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:34.848247 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-69e7f374-0a72-4f60-85b1-1d9a8c975dc4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:34.848925 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-69e7f374-0a72-4f60-85b1-1d9a8c975dc4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:34.849389 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-69e7f374-0a72-4f60-85b1-1d9a8c975dc4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:34.849814 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-69e7f374-0a72-4f60-85b1-1d9a8c975dc4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:34.978359 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-69e7f374-0a72-4f60-85b1-1d9a8c975dc4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:34.985799 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-69e7f374-0a72-4f60-85b1-1d9a8c975dc4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1674 microversion: 2.1 time: 0.149979 Sep 23 14:13:34.986834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 488/977] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:34 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:36.011375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-36f60004-26db-47a4-bea6-63522ce8ebde tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:36.012074 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-36f60004-26db-47a4-bea6-63522ce8ebde tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:36.017926 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36f60004-26db-47a4-bea6-63522ce8ebde tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:36.018440 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36f60004-26db-47a4-bea6-63522ce8ebde tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:36.018878 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36f60004-26db-47a4-bea6-63522ce8ebde tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:36.019678 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36f60004-26db-47a4-bea6-63522ce8ebde tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:36.020132 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36f60004-26db-47a4-bea6-63522ce8ebde tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:36.020556 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-36f60004-26db-47a4-bea6-63522ce8ebde tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:36.149532 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-36f60004-26db-47a4-bea6-63522ce8ebde tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:36.157255 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-36f60004-26db-47a4-bea6-63522ce8ebde tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1674 microversion: 2.1 time: 0.150315 Sep 23 14:13:36.158015 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 490/978] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:36 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:37.181777 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-3ece297e-c131-4ecd-b144-1cec181ce636 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:37.182429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-3ece297e-c131-4ecd-b144-1cec181ce636 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:37.188878 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3ece297e-c131-4ecd-b144-1cec181ce636 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:37.189362 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3ece297e-c131-4ecd-b144-1cec181ce636 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:37.189800 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3ece297e-c131-4ecd-b144-1cec181ce636 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:37.190518 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3ece297e-c131-4ecd-b144-1cec181ce636 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:37.191805 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3ece297e-c131-4ecd-b144-1cec181ce636 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:37.192391 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-3ece297e-c131-4ecd-b144-1cec181ce636 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:37.321509 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-3ece297e-c131-4ecd-b144-1cec181ce636 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:37.329239 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-3ece297e-c131-4ecd-b144-1cec181ce636 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1674 microversion: 2.1 time: 0.151241 Sep 23 14:13:37.329797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 489/979] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:37 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:38.133042 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-2121b61c-f824-4c25-bfff-c38c6afd9227 req-fdfb9675-6775-49f7-bb7c-18faffb16661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13eef24f-a406-4677-9362-460ce72549d8", "name": "network-vif-deleted", "tag": "b3bc1447-0566-4e4f-a72e-99041644a80b"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:13:38.143054 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2121b61c-f824-4c25-bfff-c38c6afd9227 req-fdfb9675-6775-49f7-bb7c-18faffb16661 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:38.143543 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2121b61c-f824-4c25-bfff-c38c6afd9227 req-fdfb9675-6775-49f7-bb7c-18faffb16661 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:38.144619 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2121b61c-f824-4c25-bfff-c38c6afd9227 req-fdfb9675-6775-49f7-bb7c-18faffb16661 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:38.156212 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-2121b61c-f824-4c25-bfff-c38c6afd9227 req-fdfb9675-6775-49f7-bb7c-18faffb16661 service nova] Creating event network-vif-deleted:b3bc1447-0566-4e4f-a72e-99041644a80b for instance 13eef24f-a406-4677-9362-460ce72549d8 on hv-cinder-85743 Sep 23 14:13:38.162000 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-2121b61c-f824-4c25-bfff-c38c6afd9227 req-fdfb9675-6775-49f7-bb7c-18faffb16661 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096133 Sep 23 14:13:38.162766 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 491/980] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:13:38.353420 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-81b42b2a-e840-4913-84da-c027bc967073 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:38.354109 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-81b42b2a-e840-4913-84da-c027bc967073 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:38.360535 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-81b42b2a-e840-4913-84da-c027bc967073 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:38.361040 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-81b42b2a-e840-4913-84da-c027bc967073 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:38.361483 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-81b42b2a-e840-4913-84da-c027bc967073 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:38.362187 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-81b42b2a-e840-4913-84da-c027bc967073 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:38.362733 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-81b42b2a-e840-4913-84da-c027bc967073 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:38.363165 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-81b42b2a-e840-4913-84da-c027bc967073 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:38.395451 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-81b42b2a-e840-4913-84da-c027bc967073 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:38.395948 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-81b42b2a-e840-4913-84da-c027bc967073 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:38.396388 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-81b42b2a-e840-4913-84da-c027bc967073 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:38.396895 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-81b42b2a-e840-4913-84da-c027bc967073 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lazy-loading 'fault' on Instance uuid 13eef24f-a406-4677-9362-460ce72549d8 {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:13:38.437605 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-81b42b2a-e840-4913-84da-c027bc967073 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:38.446075 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-81b42b2a-e840-4913-84da-c027bc967073 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 200 len: 1327 microversion: 2.1 time: 0.096369 Sep 23 14:13:38.446703 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 490/981] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:38 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:39.471332 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d796d305-23c4-4b7c-bc3c-b5dc6acfdbe7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:39.472035 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d796d305-23c4-4b7c-bc3c-b5dc6acfdbe7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:39.478525 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d796d305-23c4-4b7c-bc3c-b5dc6acfdbe7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:39.479014 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d796d305-23c4-4b7c-bc3c-b5dc6acfdbe7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:39.479456 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d796d305-23c4-4b7c-bc3c-b5dc6acfdbe7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:39.480249 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d796d305-23c4-4b7c-bc3c-b5dc6acfdbe7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:39.480707 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d796d305-23c4-4b7c-bc3c-b5dc6acfdbe7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:39.481134 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d796d305-23c4-4b7c-bc3c-b5dc6acfdbe7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:39.495049 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-d796d305-23c4-4b7c-bc3c-b5dc6acfdbe7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] HTTP exception thrown: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d796d305-23c4-4b7c-bc3c-b5dc6acfdbe7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Request method failure captured: Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 HTTP/1.1 Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLb5X-yhpnzm_-dStJA8fy45iASzeRii36n72gOkSoH7IIyvY4Rj5v3-46JcJoog3Lu0Qjih9tyWvND7sey35jZRAzb0eX474-mOZiteIYlM7ln0VX-gf7U0HLuwt4nTsLITevLOMOW1NNY8o_rwW8qIlw6jtu_kY8zTy9HyZPbkMPPQ Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 403c04c19c0c45398d6b232c03a4b7a6 Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:13:39.496637 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:13:39.498371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_403c04c19c0c45398d6b232c03a4b7a6"}]}] Sep 23 14:13:39.498371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:13:39.498371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 403c04c19c0c45398d6b232c03a4b7a6 Sep 23 14:13:39.498371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:13:39.498371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-AttachVolumeTestJSON-748341513-project Sep 23 14:13:39.498371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:13:39.498371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:13:39.498371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 1e18b5b70f8b4939bebae2d7ef261740 Sep 23 14:13:39.498371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-AttachVolumeTestJSON-748341513-project Sep 23 14:13:39.498371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:13:39.498371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:13:39.498371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '13eef24f-a406-4677-9362-460ce72549d8'} Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:13:39.499516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:13:39.501115 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:13:39.502681 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d796d305-23c4-4b7c-bc3c-b5dc6acfdbe7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Returning 404 to user: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:13:39.502681 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d796d305-23c4-4b7c-bc3c-b5dc6acfdbe7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 404 len: 111 microversion: 2.1 time: 0.031549 Sep 23 14:13:39.502681 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 492/982] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:39 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:13:39.507798 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9356ab2d-dd5b-4a78-b8e9-024a08f570d7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '.version_select at 0x7f9083af9c10>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:39.512252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9356ab2d-dd5b-4a78-b8e9-024a08f570d7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [0b8ac930-1ffd-46f4-87c6-8e340d45be1d] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 14:13:40.519227 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO oslo.messaging._drivers.impl_rabbit [None req-9356ab2d-dd5b-4a78-b8e9-024a08f570d7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [0b8ac930-1ffd-46f4-87c6-8e340d45be1d] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 49808. Sep 23 14:13:40.608716 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-9356ab2d-dd5b-4a78-b8e9-024a08f570d7 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-786975622" status: 202 len: 0 microversion: 2.1 time: 1.105491 Sep 23 14:13:40.609270 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 491/983] 10.222.0.62 () {58 vars in 1218 bytes} [Fri Sep 23 14:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-786975622 => generated 0 bytes in 1107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:13:41.351835 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-15cfe4cb-e607-4283-a417-91c521153d9b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Action: 'create', calling method: .version_select at 0x7f9083aa00d0>, body: {"keypair": {"name": "tempest-keypair-1905295195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQKuUtVRLfqe1KNotzSv+cTUEFcMLSjDIeExsiYGA/MQxkGQZb2X61Ojf3bybWYmNZjuvxxlgd2vFFZ0NMFcE9sHHWOvmM68NmSpCtiQIZEhr1xu63m9absKKsFhjJqQg=="}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:13:41.368346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-15cfe4cb-e607-4283-a417-91c521153d9b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Getting quotas for project 403c04c19c0c45398d6b232c03a4b7a6. Resources: {'key_pairs'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:13:41.372149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-15cfe4cb-e607-4283-a417-91c521153d9b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Getting quotas for user 1e18b5b70f8b4939bebae2d7ef261740 and project 403c04c19c0c45398d6b232c03a4b7a6. Resources: {'key_pairs'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:13:41.437217 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-15cfe4cb-e607-4283-a417-91c521153d9b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.089804 Sep 23 14:13:41.437799 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 493/984] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 23 14:13:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:13:43.763484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1371168396", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef3d91d5-5a9a-46ba-ba3d-c86fbc383224"}], "security_groups": [{"name": "tempest-securitygroup--1655053212"}], "key_name": "tempest-keypair-1905295195", "user_data": "}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:13:43.863578 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.network.neutron [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] validate_networks() for [('ef3d91d5-5a9a-46ba-ba3d-c86fbc383224', None, None, None, None, None)] {{(pid=121074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:13:44.272929 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Flavor limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:13:44.273379 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Image limits 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:13:44.273859 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Flavor pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:13:44.274268 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Image pref 0:0:0 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:13:44.274828 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.virt.hardware [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:13:44.283298 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:44.283826 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:44.284214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:44.284961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:44.285414 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:44.286536 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:44.303841 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Getting quotas for project 403c04c19c0c45398d6b232c03a4b7a6. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:13:44.307762 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Getting quotas for user 1e18b5b70f8b4939bebae2d7ef261740 and project 403c04c19c0c45398d6b232c03a4b7a6. Resources: {'ram', 'cores', 'instances'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:13:44.319094 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Going to run 1 instances... {{(pid=121074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:13:44.321345 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:13:44.451263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-cdc56f51-6a54-4d8e-aefa-33195b81c697 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.692517 Sep 23 14:13:44.451906 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 492/985] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:13:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 14:13:44.464401 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-0bce1677-5551-4dfc-a8ec-4d3f7818a52e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:44.465101 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-0bce1677-5551-4dfc-a8ec-4d3f7818a52e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:44.523748 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-0bce1677-5551-4dfc-a8ec-4d3f7818a52e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:44.530654 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-0bce1677-5551-4dfc-a8ec-4d3f7818a52e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1238 microversion: 2.1 time: 0.070647 Sep 23 14:13:44.531365 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 494/986] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:44 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:45.553759 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-cc22c385-dc7d-4c47-ae55-af1cffbb041c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:45.555005 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-cc22c385-dc7d-4c47-ae55-af1cffbb041c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:45.560711 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cc22c385-dc7d-4c47-ae55-af1cffbb041c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:45.561201 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cc22c385-dc7d-4c47-ae55-af1cffbb041c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:45.561638 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cc22c385-dc7d-4c47-ae55-af1cffbb041c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:45.562355 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cc22c385-dc7d-4c47-ae55-af1cffbb041c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:45.562896 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cc22c385-dc7d-4c47-ae55-af1cffbb041c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:45.565718 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cc22c385-dc7d-4c47-ae55-af1cffbb041c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:45.627992 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-cc22c385-dc7d-4c47-ae55-af1cffbb041c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:45.635602 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-cc22c385-dc7d-4c47-ae55-af1cffbb041c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1242 microversion: 2.1 time: 0.086513 Sep 23 14:13:45.636166 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 493/987] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:45 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:46.658938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-12502172-c35a-426b-be5c-fbb8f8af0358 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:46.659642 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-12502172-c35a-426b-be5c-fbb8f8af0358 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:46.666948 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-12502172-c35a-426b-be5c-fbb8f8af0358 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:46.667438 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-12502172-c35a-426b-be5c-fbb8f8af0358 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:46.667879 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-12502172-c35a-426b-be5c-fbb8f8af0358 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:46.668598 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-12502172-c35a-426b-be5c-fbb8f8af0358 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:46.669062 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-12502172-c35a-426b-be5c-fbb8f8af0358 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:46.669486 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-12502172-c35a-426b-be5c-fbb8f8af0358 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:46.732456 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-12502172-c35a-426b-be5c-fbb8f8af0358 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:46.740391 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-12502172-c35a-426b-be5c-fbb8f8af0358 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1298 microversion: 2.1 time: 0.085395 Sep 23 14:13:46.741673 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 495/988] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:46 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:47.763737 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-564d62cb-c90f-4d33-8f6a-d3ca154a19fa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:47.764468 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-564d62cb-c90f-4d33-8f6a-d3ca154a19fa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:47.770896 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-564d62cb-c90f-4d33-8f6a-d3ca154a19fa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:47.771378 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-564d62cb-c90f-4d33-8f6a-d3ca154a19fa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:47.771811 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-564d62cb-c90f-4d33-8f6a-d3ca154a19fa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:47.772787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-564d62cb-c90f-4d33-8f6a-d3ca154a19fa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:47.773781 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-564d62cb-c90f-4d33-8f6a-d3ca154a19fa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:47.774286 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-564d62cb-c90f-4d33-8f6a-d3ca154a19fa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:47.903802 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-564d62cb-c90f-4d33-8f6a-d3ca154a19fa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:47.911657 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-564d62cb-c90f-4d33-8f6a-d3ca154a19fa tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1364 microversion: 2.1 time: 0.151845 Sep 23 14:13:47.912293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 494/989] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:47 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:48.373199 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-b644a35c-eaa8-4e5e-95d4-4085408f29be req-432a1f55-8973-4e06-9b95-c47c81ad2dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc54974-8673-4c22-8a12-01964ce46743", "tag": "4ea2c684-2727-4b1c-86dc-feecc8c42d65"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:13:48.383499 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-b644a35c-eaa8-4e5e-95d4-4085408f29be req-432a1f55-8973-4e06-9b95-c47c81ad2dad service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:48.383990 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-b644a35c-eaa8-4e5e-95d4-4085408f29be req-432a1f55-8973-4e06-9b95-c47c81ad2dad service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:48.384414 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-b644a35c-eaa8-4e5e-95d4-4085408f29be req-432a1f55-8973-4e06-9b95-c47c81ad2dad service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:48.395745 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-b644a35c-eaa8-4e5e-95d4-4085408f29be req-432a1f55-8973-4e06-9b95-c47c81ad2dad service nova] Creating event network-changed:4ea2c684-2727-4b1c-86dc-feecc8c42d65 for instance 0fc54974-8673-4c22-8a12-01964ce46743 on hv-cinder-85743 Sep 23 14:13:48.400865 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-b644a35c-eaa8-4e5e-95d4-4085408f29be req-432a1f55-8973-4e06-9b95-c47c81ad2dad service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031403 Sep 23 14:13:48.401463 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 496/990] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:13:48.937957 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ce1057fc-c2ef-401b-a63f-33798199c399 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:48.939085 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ce1057fc-c2ef-401b-a63f-33798199c399 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:48.945030 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ce1057fc-c2ef-401b-a63f-33798199c399 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:48.945542 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ce1057fc-c2ef-401b-a63f-33798199c399 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:48.945983 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ce1057fc-c2ef-401b-a63f-33798199c399 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:48.946702 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ce1057fc-c2ef-401b-a63f-33798199c399 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:48.947168 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ce1057fc-c2ef-401b-a63f-33798199c399 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:48.947594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ce1057fc-c2ef-401b-a63f-33798199c399 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:49.330047 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ce1057fc-c2ef-401b-a63f-33798199c399 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:49.337923 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ce1057fc-c2ef-401b-a63f-33798199c399 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1364 microversion: 2.1 time: 0.404212 Sep 23 14:13:49.338524 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 495/991] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:48 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1364 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:50.361934 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9013fef1-2017-4dbb-a148-02b0c040ea2e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:50.362591 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9013fef1-2017-4dbb-a148-02b0c040ea2e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:50.369100 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9013fef1-2017-4dbb-a148-02b0c040ea2e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:50.369581 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9013fef1-2017-4dbb-a148-02b0c040ea2e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:50.370016 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9013fef1-2017-4dbb-a148-02b0c040ea2e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:50.370782 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9013fef1-2017-4dbb-a148-02b0c040ea2e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:50.371262 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9013fef1-2017-4dbb-a148-02b0c040ea2e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:50.371686 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9013fef1-2017-4dbb-a148-02b0c040ea2e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:50.499471 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9013fef1-2017-4dbb-a148-02b0c040ea2e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:50.507025 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9013fef1-2017-4dbb-a148-02b0c040ea2e tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1364 microversion: 2.1 time: 0.149979 Sep 23 14:13:50.507585 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 497/992] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:50 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:51.530016 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-050c1fbc-b404-46be-85f8-096bdf506c6b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:51.530577 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-050c1fbc-b404-46be-85f8-096bdf506c6b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:51.536979 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-050c1fbc-b404-46be-85f8-096bdf506c6b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:51.537455 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-050c1fbc-b404-46be-85f8-096bdf506c6b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:51.537890 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-050c1fbc-b404-46be-85f8-096bdf506c6b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:51.538594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-050c1fbc-b404-46be-85f8-096bdf506c6b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:51.539237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-050c1fbc-b404-46be-85f8-096bdf506c6b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:51.539867 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-050c1fbc-b404-46be-85f8-096bdf506c6b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:51.666717 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-050c1fbc-b404-46be-85f8-096bdf506c6b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:51.674478 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-050c1fbc-b404-46be-85f8-096bdf506c6b tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1364 microversion: 2.1 time: 0.148359 Sep 23 14:13:51.675317 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 496/993] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:51 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:52.698484 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d992f9f3-16c8-4a80-926c-ad1421cb5ee9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:52.699095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d992f9f3-16c8-4a80-926c-ad1421cb5ee9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:52.705477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d992f9f3-16c8-4a80-926c-ad1421cb5ee9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:52.705964 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d992f9f3-16c8-4a80-926c-ad1421cb5ee9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:52.706433 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d992f9f3-16c8-4a80-926c-ad1421cb5ee9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:52.707120 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d992f9f3-16c8-4a80-926c-ad1421cb5ee9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:52.707573 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d992f9f3-16c8-4a80-926c-ad1421cb5ee9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:52.707995 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d992f9f3-16c8-4a80-926c-ad1421cb5ee9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:52.832808 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d992f9f3-16c8-4a80-926c-ad1421cb5ee9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:52.841689 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d992f9f3-16c8-4a80-926c-ad1421cb5ee9 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1364 microversion: 2.1 time: 0.147717 Sep 23 14:13:52.842257 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 498/994] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:52 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:53.864910 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fd616a1a-59bd-4c0f-b5b5-1ecae2a5bc54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:53.865607 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-fd616a1a-59bd-4c0f-b5b5-1ecae2a5bc54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:53.871944 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd616a1a-59bd-4c0f-b5b5-1ecae2a5bc54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:53.872431 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd616a1a-59bd-4c0f-b5b5-1ecae2a5bc54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:53.872869 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd616a1a-59bd-4c0f-b5b5-1ecae2a5bc54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:53.873562 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd616a1a-59bd-4c0f-b5b5-1ecae2a5bc54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:53.874034 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd616a1a-59bd-4c0f-b5b5-1ecae2a5bc54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:53.874508 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fd616a1a-59bd-4c0f-b5b5-1ecae2a5bc54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:53.966486 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-9b7233bf-d2d3-4755-8a23-56526bccd862 req-875fb434-65f4-4f7c-a947-654ba091c318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc54974-8673-4c22-8a12-01964ce46743", "name": "network-vif-plugged", "status": "completed", "tag": "4ea2c684-2727-4b1c-86dc-feecc8c42d65"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:13:53.976612 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-9b7233bf-d2d3-4755-8a23-56526bccd862 req-875fb434-65f4-4f7c-a947-654ba091c318 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:53.977094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-9b7233bf-d2d3-4755-8a23-56526bccd862 req-875fb434-65f4-4f7c-a947-654ba091c318 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:53.978159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-9b7233bf-d2d3-4755-8a23-56526bccd862 req-875fb434-65f4-4f7c-a947-654ba091c318 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:53.990875 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-9b7233bf-d2d3-4755-8a23-56526bccd862 req-875fb434-65f4-4f7c-a947-654ba091c318 service nova] Creating event network-vif-plugged:4ea2c684-2727-4b1c-86dc-feecc8c42d65 for instance 0fc54974-8673-4c22-8a12-01964ce46743 on hv-cinder-85743 Sep 23 14:13:53.996114 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-9b7233bf-d2d3-4755-8a23-56526bccd862 req-875fb434-65f4-4f7c-a947-654ba091c318 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092520 Sep 23 14:13:53.996711 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 499/995] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:13:54.013325 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fd616a1a-59bd-4c0f-b5b5-1ecae2a5bc54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:54.020213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fd616a1a-59bd-4c0f-b5b5-1ecae2a5bc54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1364 microversion: 2.1 time: 0.159219 Sep 23 14:13:54.020791 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 497/996] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:53 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:55.043200 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=6 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:13:55.047769 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-bd4fbce9-221a-4a06-b12f-d340f7600695 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:55.048465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-bd4fbce9-221a-4a06-b12f-d340f7600695 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:55.054802 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bd4fbce9-221a-4a06-b12f-d340f7600695 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:55.055284 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bd4fbce9-221a-4a06-b12f-d340f7600695 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:55.056353 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bd4fbce9-221a-4a06-b12f-d340f7600695 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:55.057235 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bd4fbce9-221a-4a06-b12f-d340f7600695 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:55.057687 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bd4fbce9-221a-4a06-b12f-d340f7600695 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:55.058108 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-bd4fbce9-221a-4a06-b12f-d340f7600695 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:55.194516 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-bd4fbce9-221a-4a06-b12f-d340f7600695 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:55.196052 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-bd4fbce9-221a-4a06-b12f-d340f7600695 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1364 microversion: 2.1 time: 0.153905 Sep 23 14:13:55.196644 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 500/997] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:55 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:56.218400 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1c7e0fab-b060-47b7-a7ec-4cecbe4d3bd1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:56.219034 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1c7e0fab-b060-47b7-a7ec-4cecbe4d3bd1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:56.220849 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:13:56.221516 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=6 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:13:56.226775 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1c7e0fab-b060-47b7-a7ec-4cecbe4d3bd1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:56.227281 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1c7e0fab-b060-47b7-a7ec-4cecbe4d3bd1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:56.228213 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1c7e0fab-b060-47b7-a7ec-4cecbe4d3bd1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:56.228895 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1c7e0fab-b060-47b7-a7ec-4cecbe4d3bd1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:56.229354 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1c7e0fab-b060-47b7-a7ec-4cecbe4d3bd1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:56.229779 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1c7e0fab-b060-47b7-a7ec-4cecbe4d3bd1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:56.358204 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-1c7e0fab-b060-47b7-a7ec-4cecbe4d3bd1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:13:56.365850 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1c7e0fab-b060-47b7-a7ec-4cecbe4d3bd1 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1551 microversion: 2.1 time: 0.151324 Sep 23 14:13:56.366382 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 498/998] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:13:56 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:13:56.388742 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-b09298cb-970f-4b28-8436-7cfd321f748f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:13:56.389317 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-b09298cb-970f-4b28-8436-7cfd321f748f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:13:56.395640 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b09298cb-970f-4b28-8436-7cfd321f748f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:56.396159 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b09298cb-970f-4b28-8436-7cfd321f748f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:56.396596 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b09298cb-970f-4b28-8436-7cfd321f748f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:56.397282 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b09298cb-970f-4b28-8436-7cfd321f748f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:56.397738 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b09298cb-970f-4b28-8436-7cfd321f748f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:56.398162 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-b09298cb-970f-4b28-8436-7cfd321f748f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:56.472889 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-b09298cb-970f-4b28-8436-7cfd321f748f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088115 Sep 23 14:13:56.473475 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 501/999] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 23 14:13:56 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:13:57.492675 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-b98a96cb-40a5-46a4-886d-00b88cb9f54a req-bcc01dc1-cde0-4933-9188-052a0a4d2fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc54974-8673-4c22-8a12-01964ce46743", "tag": "4ea2c684-2727-4b1c-86dc-feecc8c42d65"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:13:57.502701 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-b98a96cb-40a5-46a4-886d-00b88cb9f54a req-bcc01dc1-cde0-4933-9188-052a0a4d2fe4 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:13:57.503286 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-b98a96cb-40a5-46a4-886d-00b88cb9f54a req-bcc01dc1-cde0-4933-9188-052a0a4d2fe4 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:13:57.503787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-b98a96cb-40a5-46a4-886d-00b88cb9f54a req-bcc01dc1-cde0-4933-9188-052a0a4d2fe4 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:13:57.515953 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-b98a96cb-40a5-46a4-886d-00b88cb9f54a req-bcc01dc1-cde0-4933-9188-052a0a4d2fe4 service nova] Creating event network-changed:4ea2c684-2727-4b1c-86dc-feecc8c42d65 for instance 0fc54974-8673-4c22-8a12-01964ce46743 on hv-cinder-85743 Sep 23 14:13:57.521311 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-b98a96cb-40a5-46a4-886d-00b88cb9f54a req-bcc01dc1-cde0-4933-9188-052a0a4d2fe4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094282 Sep 23 14:13:57.521946 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 499/1000] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:14:33.443202 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:14:33.444041 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:14:33.448537 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-48181c17-cd13-480e-bea5-0344e62fc5ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:14:33.449068 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-48181c17-cd13-480e-bea5-0344e62fc5ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:14:33.455594 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-48181c17-cd13-480e-bea5-0344e62fc5ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:33.457659 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-48181c17-cd13-480e-bea5-0344e62fc5ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:33.457659 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-48181c17-cd13-480e-bea5-0344e62fc5ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:33.457659 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-48181c17-cd13-480e-bea5-0344e62fc5ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:33.457659 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-48181c17-cd13-480e-bea5-0344e62fc5ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:33.458172 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-48181c17-cd13-480e-bea5-0344e62fc5ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:33.481767 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-48181c17-cd13-480e-bea5-0344e62fc5ad tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/ips" status: 200 len: 147 microversion: 2.1 time: 0.039900 Sep 23 14:14:33.482257 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 502/1001] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 23 14:14:33 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:14:35.113775 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:14:35.114570 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=66 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:14:35.119440 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f1e95db1-5249-445d-b22e-df1db81e1974 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78cd69c7-4226-4e6e-8ad1-ed6b92a509f2"}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:14:35.130010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f1e95db1-5249-445d-b22e-df1db81e1974 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:14:35.130010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f1e95db1-5249-445d-b22e-df1db81e1974 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:35.130010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f1e95db1-5249-445d-b22e-df1db81e1974 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:35.130010 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f1e95db1-5249-445d-b22e-df1db81e1974 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:35.130552 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f1e95db1-5249-445d-b22e-df1db81e1974 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:35.130552 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f1e95db1-5249-445d-b22e-df1db81e1974 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:35.130552 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f1e95db1-5249-445d-b22e-df1db81e1974 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:35.953170 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f1e95db1-5249-445d-b22e-df1db81e1974 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "POST /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840656 Sep 23 14:14:35.953801 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 500/1002] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 23 14:14:35 2022] POST /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments => generated 194 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:14:43.590996 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5409d94c-0ed1-44d9-a844-8d4bd59c0332 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:14:43.593330 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5409d94c-0ed1-44d9-a844-8d4bd59c0332 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:14:43.601026 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5409d94c-0ed1-44d9-a844-8d4bd59c0332 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:43.601515 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5409d94c-0ed1-44d9-a844-8d4bd59c0332 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:43.601957 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5409d94c-0ed1-44d9-a844-8d4bd59c0332 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:43.602713 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5409d94c-0ed1-44d9-a844-8d4bd59c0332 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:43.603172 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5409d94c-0ed1-44d9-a844-8d4bd59c0332 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:43.603647 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5409d94c-0ed1-44d9-a844-8d4bd59c0332 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:43.635884 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5409d94c-0ed1-44d9-a844-8d4bd59c0332 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049278 Sep 23 14:14:43.636561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 503/1003] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:14:43 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:14:43.648793 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-91872532-c237-4b12-9bf6-c028156ba2bc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:14:43.649412 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-91872532-c237-4b12-9bf6-c028156ba2bc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:14:43.655763 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-91872532-c237-4b12-9bf6-c028156ba2bc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:43.657631 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-91872532-c237-4b12-9bf6-c028156ba2bc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:43.657631 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-91872532-c237-4b12-9bf6-c028156ba2bc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:43.657631 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-91872532-c237-4b12-9bf6-c028156ba2bc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:43.657991 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-91872532-c237-4b12-9bf6-c028156ba2bc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:43.658195 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-91872532-c237-4b12-9bf6-c028156ba2bc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:43.690547 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-91872532-c237-4b12-9bf6-c028156ba2bc tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments/78cd69c7-4226-4e6e-8ad1-ed6b92a509f2" status: 200 len: 194 microversion: 2.1 time: 0.046749 Sep 23 14:14:43.691147 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 501/1004] 10.222.0.62 () {58 vars in 1413 bytes} [Fri Sep 23 14:14:43 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments/78cd69c7-4226-4e6e-8ad1-ed6b92a509f2 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:14:45.283505 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-67abc44d-05b8-47de-a8e8-3ddca44d9ccf tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2faaf66-6a3b-489e-b34a-81b88cd2a171"}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:14:45.285843 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-67abc44d-05b8-47de-a8e8-3ddca44d9ccf tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:14:45.293677 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-67abc44d-05b8-47de-a8e8-3ddca44d9ccf tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:45.294371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-67abc44d-05b8-47de-a8e8-3ddca44d9ccf tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:45.294858 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-67abc44d-05b8-47de-a8e8-3ddca44d9ccf tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:45.295659 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-67abc44d-05b8-47de-a8e8-3ddca44d9ccf tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:45.296117 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-67abc44d-05b8-47de-a8e8-3ddca44d9ccf tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:45.296567 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-67abc44d-05b8-47de-a8e8-3ddca44d9ccf tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:46.198176 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-67abc44d-05b8-47de-a8e8-3ddca44d9ccf tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "POST /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.918916 Sep 23 14:14:46.198860 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 504/1005] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 23 14:14:45 2022] POST /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments => generated 194 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:14:54.822731 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7406fbc1-686e-4158-a9ea-5b27c95275a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:14:54.825399 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7406fbc1-686e-4158-a9ea-5b27c95275a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:14:54.827910 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=4 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:14:54.828590 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:14:54.833278 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7406fbc1-686e-4158-a9ea-5b27c95275a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:54.833767 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7406fbc1-686e-4158-a9ea-5b27c95275a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:54.834205 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7406fbc1-686e-4158-a9ea-5b27c95275a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:54.834928 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7406fbc1-686e-4158-a9ea-5b27c95275a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:54.835390 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7406fbc1-686e-4158-a9ea-5b27c95275a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:54.835823 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7406fbc1-686e-4158-a9ea-5b27c95275a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:54.868758 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7406fbc1-686e-4158-a9ea-5b27c95275a0 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049958 Sep 23 14:14:54.869312 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 502/1006] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:14:54 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:14:55.038195 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8530b4e1-781f-4fdc-8555-d3eaa8e87ea3 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:14:55.038744 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-8530b4e1-781f-4fdc-8555-d3eaa8e87ea3 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:14:55.045902 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8530b4e1-781f-4fdc-8555-d3eaa8e87ea3 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:55.046415 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8530b4e1-781f-4fdc-8555-d3eaa8e87ea3 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:55.046859 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8530b4e1-781f-4fdc-8555-d3eaa8e87ea3 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:55.047826 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8530b4e1-781f-4fdc-8555-d3eaa8e87ea3 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:55.048283 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8530b4e1-781f-4fdc-8555-d3eaa8e87ea3 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:55.048710 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8530b4e1-781f-4fdc-8555-d3eaa8e87ea3 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:55.077454 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8530b4e1-781f-4fdc-8555-d3eaa8e87ea3 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments/78cd69c7-4226-4e6e-8ad1-ed6b92a509f2" status: 200 len: 194 microversion: 2.1 time: 0.044367 Sep 23 14:14:55.078079 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 505/1007] 10.222.0.62 () {58 vars in 1413 bytes} [Fri Sep 23 14:14:55 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments/78cd69c7-4226-4e6e-8ad1-ed6b92a509f2 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:14:55.090070 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-00bdb088-e252-46cd-ba3f-4816c44c6494 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:14:55.090628 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-00bdb088-e252-46cd-ba3f-4816c44c6494 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:14:55.097032 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-00bdb088-e252-46cd-ba3f-4816c44c6494 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:55.097522 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-00bdb088-e252-46cd-ba3f-4816c44c6494 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:55.097961 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-00bdb088-e252-46cd-ba3f-4816c44c6494 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:55.098697 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-00bdb088-e252-46cd-ba3f-4816c44c6494 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:55.099159 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-00bdb088-e252-46cd-ba3f-4816c44c6494 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:55.099587 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-00bdb088-e252-46cd-ba3f-4816c44c6494 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:55.181207 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-00bdb088-e252-46cd-ba3f-4816c44c6494 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lazy-loading 'services' on Instance uuid 0fc54974-8673-4c22-8a12-01964ce46743 {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:14:55.535708 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-00bdb088-e252-46cd-ba3f-4816c44c6494 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments/78cd69c7-4226-4e6e-8ad1-ed6b92a509f2" status: 202 len: 0 microversion: 2.1 time: 0.450737 Sep 23 14:14:55.536354 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 503/1008] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 23 14:14:55 2022] DELETE /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments/78cd69c7-4226-4e6e-8ad1-ed6b92a509f2 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:14:57.715280 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-0a7d3ddf-cdb0-4fff-bddf-d8889f267ead tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:14:57.725167 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-0a7d3ddf-cdb0-4fff-bddf-d8889f267ead tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:14:57.725167 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a7d3ddf-cdb0-4fff-bddf-d8889f267ead tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:57.725167 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a7d3ddf-cdb0-4fff-bddf-d8889f267ead tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:57.725167 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a7d3ddf-cdb0-4fff-bddf-d8889f267ead tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:57.725562 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a7d3ddf-cdb0-4fff-bddf-d8889f267ead tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:57.725562 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a7d3ddf-cdb0-4fff-bddf-d8889f267ead tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:57.725562 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0a7d3ddf-cdb0-4fff-bddf-d8889f267ead tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:57.754607 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-0a7d3ddf-cdb0-4fff-bddf-d8889f267ead tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments/b2faaf66-6a3b-489e-b34a-81b88cd2a171" status: 200 len: 194 microversion: 2.1 time: 0.043382 Sep 23 14:14:57.755181 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 506/1009] 10.222.0.62 () {58 vars in 1413 bytes} [Fri Sep 23 14:14:57 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments/b2faaf66-6a3b-489e-b34a-81b88cd2a171 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:14:57.766898 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-403cc4c5-37f9-49ad-a74b-b50abee15727 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:14:57.767475 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-403cc4c5-37f9-49ad-a74b-b50abee15727 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:14:57.773560 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-403cc4c5-37f9-49ad-a74b-b50abee15727 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:57.774039 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-403cc4c5-37f9-49ad-a74b-b50abee15727 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:57.774510 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-403cc4c5-37f9-49ad-a74b-b50abee15727 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:57.775196 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-403cc4c5-37f9-49ad-a74b-b50abee15727 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:57.775647 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-403cc4c5-37f9-49ad-a74b-b50abee15727 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:57.776069 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-403cc4c5-37f9-49ad-a74b-b50abee15727 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:57.867825 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-403cc4c5-37f9-49ad-a74b-b50abee15727 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lazy-loading 'services' on Instance uuid 0fc54974-8673-4c22-8a12-01964ce46743 {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:14:58.089668 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-403cc4c5-37f9-49ad-a74b-b50abee15727 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments/b2faaf66-6a3b-489e-b34a-81b88cd2a171" status: 202 len: 0 microversion: 2.1 time: 0.327160 Sep 23 14:14:58.090511 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 504/1010] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 23 14:14:57 2022] DELETE /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments/b2faaf66-6a3b-489e-b34a-81b88cd2a171 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:14:59.311094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e175e027-2b9c-4d93-b057-d79829f079ce tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:14:59.314321 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e175e027-2b9c-4d93-b057-d79829f079ce tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:14:59.324890 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e175e027-2b9c-4d93-b057-d79829f079ce tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:59.327052 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e175e027-2b9c-4d93-b057-d79829f079ce tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:59.327052 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e175e027-2b9c-4d93-b057-d79829f079ce tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:59.327609 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e175e027-2b9c-4d93-b057-d79829f079ce tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:59.328398 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e175e027-2b9c-4d93-b057-d79829f079ce tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:59.329102 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e175e027-2b9c-4d93-b057-d79829f079ce tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:59.371378 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e175e027-2b9c-4d93-b057-d79829f079ce tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066514 Sep 23 14:14:59.372592 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 507/1011] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:14:59 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 14:14:59.533939 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8a4e28fe-a984-4436-8f60-e0bfdd72a30a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:14:59.536416 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8a4e28fe-a984-4436-8f60-e0bfdd72a30a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:14:59.544268 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8a4e28fe-a984-4436-8f60-e0bfdd72a30a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:59.544831 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8a4e28fe-a984-4436-8f60-e0bfdd72a30a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:59.545306 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8a4e28fe-a984-4436-8f60-e0bfdd72a30a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:59.546101 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8a4e28fe-a984-4436-8f60-e0bfdd72a30a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:59.546628 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8a4e28fe-a984-4436-8f60-e0bfdd72a30a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:59.547341 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8a4e28fe-a984-4436-8f60-e0bfdd72a30a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:59.581326 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8a4e28fe-a984-4436-8f60-e0bfdd72a30a tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052122 Sep 23 14:14:59.581900 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 505/1012] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:14:59 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 14:14:59.673056 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-16cdd82e-180e-46cf-856e-cc0342889a4c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:14:59.673560 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-16cdd82e-180e-46cf-856e-cc0342889a4c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:14:59.685561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-16cdd82e-180e-46cf-856e-cc0342889a4c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:59.687994 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-16cdd82e-180e-46cf-856e-cc0342889a4c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:59.687994 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-16cdd82e-180e-46cf-856e-cc0342889a4c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:59.687994 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-16cdd82e-180e-46cf-856e-cc0342889a4c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:14:59.690006 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-16cdd82e-180e-46cf-856e-cc0342889a4c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:14:59.690006 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-16cdd82e-180e-46cf-856e-cc0342889a4c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:14:59.728268 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-16cdd82e-180e-46cf-856e-cc0342889a4c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Going to try to terminate instance {{(pid=121073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:15:00.172015 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-16cdd82e-180e-46cf-856e-cc0342889a4c tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 204 len: 0 microversion: 2.1 time: 0.506388 Sep 23 14:15:00.172638 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 508/1013] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:14:59 2022] DELETE /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:15:00.181261 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-cfed67cc-0a75-464a-b578-ce608a193070 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:15:00.182119 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-cfed67cc-0a75-464a-b578-ce608a193070 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:15:00.188746 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cfed67cc-0a75-464a-b578-ce608a193070 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:00.189255 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cfed67cc-0a75-464a-b578-ce608a193070 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:00.189678 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cfed67cc-0a75-464a-b578-ce608a193070 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:00.190405 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cfed67cc-0a75-464a-b578-ce608a193070 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:00.190939 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cfed67cc-0a75-464a-b578-ce608a193070 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:00.191363 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-cfed67cc-0a75-464a-b578-ce608a193070 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:00.328940 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-cfed67cc-0a75-464a-b578-ce608a193070 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:15:00.336768 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-cfed67cc-0a75-464a-b578-ce608a193070 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1676 microversion: 2.1 time: 0.159654 Sep 23 14:15:00.337333 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 506/1014] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:15:00 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:15:01.362284 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c9a2051f-13e0-43fc-b4f0-09bcca14b47d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:15:01.363022 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c9a2051f-13e0-43fc-b4f0-09bcca14b47d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:15:01.369451 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9a2051f-13e0-43fc-b4f0-09bcca14b47d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:01.369940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9a2051f-13e0-43fc-b4f0-09bcca14b47d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:01.370417 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9a2051f-13e0-43fc-b4f0-09bcca14b47d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:01.371537 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9a2051f-13e0-43fc-b4f0-09bcca14b47d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:01.372094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9a2051f-13e0-43fc-b4f0-09bcca14b47d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:01.372614 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c9a2051f-13e0-43fc-b4f0-09bcca14b47d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:01.503746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c9a2051f-13e0-43fc-b4f0-09bcca14b47d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:15:01.512027 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c9a2051f-13e0-43fc-b4f0-09bcca14b47d tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1676 microversion: 2.1 time: 0.153595 Sep 23 14:15:01.512588 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 509/1015] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:15:01 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:15:02.537898 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6b218633-8886-4d9d-8299-a8e06a7ab151 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:15:02.538549 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6b218633-8886-4d9d-8299-a8e06a7ab151 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:15:02.545805 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b218633-8886-4d9d-8299-a8e06a7ab151 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:02.546295 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b218633-8886-4d9d-8299-a8e06a7ab151 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:02.547029 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b218633-8886-4d9d-8299-a8e06a7ab151 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:02.547722 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b218633-8886-4d9d-8299-a8e06a7ab151 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:02.548183 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b218633-8886-4d9d-8299-a8e06a7ab151 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:02.548608 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6b218633-8886-4d9d-8299-a8e06a7ab151 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:02.680406 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6b218633-8886-4d9d-8299-a8e06a7ab151 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:15:02.688654 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6b218633-8886-4d9d-8299-a8e06a7ab151 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1676 microversion: 2.1 time: 0.154648 Sep 23 14:15:02.689472 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 507/1016] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:15:02 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:15:03.196961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-53464f70-5c98-4e6a-afe0-91318b64b0ea req-6e5196bc-7d55-4d00-81e5-63b1cfce9fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc54974-8673-4c22-8a12-01964ce46743", "name": "network-vif-deleted", "tag": "4ea2c684-2727-4b1c-86dc-feecc8c42d65"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:15:03.209377 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-53464f70-5c98-4e6a-afe0-91318b64b0ea req-6e5196bc-7d55-4d00-81e5-63b1cfce9fce service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:03.216952 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-53464f70-5c98-4e6a-afe0-91318b64b0ea req-6e5196bc-7d55-4d00-81e5-63b1cfce9fce service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:03.216952 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-53464f70-5c98-4e6a-afe0-91318b64b0ea req-6e5196bc-7d55-4d00-81e5-63b1cfce9fce service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:03.222920 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-53464f70-5c98-4e6a-afe0-91318b64b0ea req-6e5196bc-7d55-4d00-81e5-63b1cfce9fce service nova] Creating event network-vif-deleted:4ea2c684-2727-4b1c-86dc-feecc8c42d65 for instance 0fc54974-8673-4c22-8a12-01964ce46743 on hv-cinder-85743 Sep 23 14:15:03.228563 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-53464f70-5c98-4e6a-afe0-91318b64b0ea req-6e5196bc-7d55-4d00-81e5-63b1cfce9fce service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035272 Sep 23 14:15:03.229375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 510/1017] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:15:03.713017 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-66ac9d0e-a5a2-4973-ac1c-4c6da452415f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:15:03.713635 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-66ac9d0e-a5a2-4973-ac1c-4c6da452415f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:15:03.720524 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66ac9d0e-a5a2-4973-ac1c-4c6da452415f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:03.720932 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66ac9d0e-a5a2-4973-ac1c-4c6da452415f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:03.721375 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66ac9d0e-a5a2-4973-ac1c-4c6da452415f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:03.722075 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66ac9d0e-a5a2-4973-ac1c-4c6da452415f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:03.726036 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66ac9d0e-a5a2-4973-ac1c-4c6da452415f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:03.726532 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66ac9d0e-a5a2-4973-ac1c-4c6da452415f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:03.761932 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66ac9d0e-a5a2-4973-ac1c-4c6da452415f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:03.762459 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66ac9d0e-a5a2-4973-ac1c-4c6da452415f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:03.762908 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66ac9d0e-a5a2-4973-ac1c-4c6da452415f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:03.763364 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-66ac9d0e-a5a2-4973-ac1c-4c6da452415f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lazy-loading 'fault' on Instance uuid 0fc54974-8673-4c22-8a12-01964ce46743 {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:15:03.811100 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-66ac9d0e-a5a2-4973-ac1c-4c6da452415f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e18b5b70f8b4939bebae2d7ef261740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403c04c19c0c45398d6b232c03a4b7a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:15:03.818904 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-66ac9d0e-a5a2-4973-ac1c-4c6da452415f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 200 len: 1328 microversion: 2.1 time: 0.109846 Sep 23 14:15:03.819476 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 508/1018] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:15:03 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:15:04.842969 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a46bf42a-0fd2-4b7f-8943-f32a03893be4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:15:04.843808 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a46bf42a-0fd2-4b7f-8943-f32a03893be4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:15:04.850614 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a46bf42a-0fd2-4b7f-8943-f32a03893be4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:04.851098 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a46bf42a-0fd2-4b7f-8943-f32a03893be4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:04.851529 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a46bf42a-0fd2-4b7f-8943-f32a03893be4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:04.852215 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a46bf42a-0fd2-4b7f-8943-f32a03893be4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:04.852670 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a46bf42a-0fd2-4b7f-8943-f32a03893be4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:04.853093 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a46bf42a-0fd2-4b7f-8943-f32a03893be4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:04.867289 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-a46bf42a-0fd2-4b7f-8943-f32a03893be4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] HTTP exception thrown: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a46bf42a-0fd2-4b7f-8943-f32a03893be4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Request method failure captured: Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 HTTP/1.1 Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLb5X-yhpnzm_-dStJA8fy45iASzeRii36n72gOkSoH7IIyvY4Rj5v3-46JcJoog3Lu0Qjih9tyWvND7sey35jZRAzb0eX474-mOZiteIYlM7ln0VX-gf7U0HLuwt4nTsLITevLOMOW1NNY8o_rwW8qIlw6jtu_kY8zTy9HyZPbkMPPQ Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 403c04c19c0c45398d6b232c03a4b7a6 Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:15:04.868897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:15:04.870719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_403c04c19c0c45398d6b232c03a4b7a6"}]}] Sep 23 14:15:04.870719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:04.870719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 403c04c19c0c45398d6b232c03a4b7a6 Sep 23 14:15:04.870719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:04.870719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-AttachVolumeTestJSON-748341513-project Sep 23 14:15:04.870719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:15:04.870719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:15:04.870719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 1e18b5b70f8b4939bebae2d7ef261740 Sep 23 14:15:04.870719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-AttachVolumeTestJSON-748341513-project Sep 23 14:15:04.870719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:15:04.870719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:04.870719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '0fc54974-8673-4c22-8a12-01964ce46743'} Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:15:04.871783 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:04.873355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:04.875043 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a46bf42a-0fd2-4b7f-8943-f32a03893be4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Returning 404 to user: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:15:04.875043 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a46bf42a-0fd2-4b7f-8943-f32a03893be4 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 404 len: 111 microversion: 2.1 time: 0.032307 Sep 23 14:15:04.875043 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 511/1019] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:15:04 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:15:04.879360 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-55d441bd-1ea3-4418-b4aa-1e9ebabc2c4f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '.version_select at 0x7f908b42c9d0>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:15:04.958735 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-55d441bd-1ea3-4418-b4aa-1e9ebabc2c4f tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905295195" status: 202 len: 0 microversion: 2.1 time: 0.083102 Sep 23 14:15:04.959331 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 509/1020] 10.222.0.62 () {58 vars in 1221 bytes} [Fri Sep 23 14:15:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905295195 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 14:15:08.606753 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a884209f-dae0-4509-95fd-da080a06c918 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:15:08.607304 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a884209f-dae0-4509-95fd-da080a06c918 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:15:08.613966 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a884209f-dae0-4509-95fd-da080a06c918 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:08.614493 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a884209f-dae0-4509-95fd-da080a06c918 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:08.614938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a884209f-dae0-4509-95fd-da080a06c918 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:08.615645 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a884209f-dae0-4509-95fd-da080a06c918 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:08.616109 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a884209f-dae0-4509-95fd-da080a06c918 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:08.616550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a884209f-dae0-4509-95fd-da080a06c918 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:08.630985 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-a884209f-dae0-4509-95fd-da080a06c918 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] HTTP exception thrown: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a884209f-dae0-4509-95fd-da080a06c918 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Request method failure captured: Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: DELETE /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 HTTP/1.1 Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLb5X-yhpnzm_-dStJA8fy45iASzeRii36n72gOkSoH7IIyvY4Rj5v3-46JcJoog3Lu0Qjih9tyWvND7sey35jZRAzb0eX474-mOZiteIYlM7ln0VX-gf7U0HLuwt4nTsLITevLOMOW1NNY8o_rwW8qIlw6jtu_kY8zTy9HyZPbkMPPQ Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 403c04c19c0c45398d6b232c03a4b7a6 Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:15:08.632526 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:15:08.634095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_403c04c19c0c45398d6b232c03a4b7a6"}]}] Sep 23 14:15:08.634095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:08.634095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 403c04c19c0c45398d6b232c03a4b7a6 Sep 23 14:15:08.634095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:08.634095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-AttachVolumeTestJSON-748341513-project Sep 23 14:15:08.634095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:15:08.634095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:15:08.634095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 1e18b5b70f8b4939bebae2d7ef261740 Sep 23 14:15:08.634095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-AttachVolumeTestJSON-748341513-project Sep 23 14:15:08.634095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:15:08.634095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:08.634095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '0fc54974-8673-4c22-8a12-01964ce46743'} Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:15:08.635219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:08.636760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:08.638990 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a884209f-dae0-4509-95fd-da080a06c918 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Returning 404 to user: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:15:08.638990 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a884209f-dae0-4509-95fd-da080a06c918 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 404 len: 111 microversion: 2.1 time: 0.031792 Sep 23 14:15:08.638990 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 512/1021] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:15:08 2022] DELETE /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:15:08.644212 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e5b2deb5-9bf9-46c9-aba0-0ee9a0a245ff tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:15:08.644827 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e5b2deb5-9bf9-46c9-aba0-0ee9a0a245ff tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 0fc54974-8673-4c22-8a12-01964ce46743] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:15:08.651665 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e5b2deb5-9bf9-46c9-aba0-0ee9a0a245ff tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:08.652164 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e5b2deb5-9bf9-46c9-aba0-0ee9a0a245ff tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:08.653190 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e5b2deb5-9bf9-46c9-aba0-0ee9a0a245ff tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:08.653930 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e5b2deb5-9bf9-46c9-aba0-0ee9a0a245ff tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:08.654439 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e5b2deb5-9bf9-46c9-aba0-0ee9a0a245ff tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:08.654876 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e5b2deb5-9bf9-46c9-aba0-0ee9a0a245ff tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:08.670123 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-e5b2deb5-9bf9-46c9-aba0-0ee9a0a245ff tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] HTTP exception thrown: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e5b2deb5-9bf9-46c9-aba0-0ee9a0a245ff tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Request method failure captured: Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 HTTP/1.1 Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLb5X-yhpnzm_-dStJA8fy45iASzeRii36n72gOkSoH7IIyvY4Rj5v3-46JcJoog3Lu0Qjih9tyWvND7sey35jZRAzb0eX474-mOZiteIYlM7ln0VX-gf7U0HLuwt4nTsLITevLOMOW1NNY8o_rwW8qIlw6jtu_kY8zTy9HyZPbkMPPQ Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 403c04c19c0c45398d6b232c03a4b7a6 Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:15:08.672056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:15:08.673646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_403c04c19c0c45398d6b232c03a4b7a6"}]}] Sep 23 14:15:08.673646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:08.673646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 403c04c19c0c45398d6b232c03a4b7a6 Sep 23 14:15:08.673646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:08.673646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-AttachVolumeTestJSON-748341513-project Sep 23 14:15:08.673646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:15:08.673646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:15:08.673646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 1e18b5b70f8b4939bebae2d7ef261740 Sep 23 14:15:08.673646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-AttachVolumeTestJSON-748341513-project Sep 23 14:15:08.673646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:15:08.673646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:08.673646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': '0fc54974-8673-4c22-8a12-01964ce46743'} Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:15:08.674809 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. Sep 23 14:15:08.676314 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:15:08.677789 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e5b2deb5-9bf9-46c9-aba0-0ee9a0a245ff tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Returning 404 to user: Instance 0fc54974-8673-4c22-8a12-01964ce46743 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:15:08.677789 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e5b2deb5-9bf9-46c9-aba0-0ee9a0a245ff tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743" status: 404 len: 111 microversion: 2.1 time: 0.033628 Sep 23 14:15:08.677789 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 510/1022] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:15:08 2022] GET /compute/v2.1/servers/0fc54974-8673-4c22-8a12-01964ce46743 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 14:15:09.994084 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8f7b8439-12f7-4525-97a0-d98139138e54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:15:09.994677 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-8f7b8439-12f7-4525-97a0-d98139138e54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:15:10.002784 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f7b8439-12f7-4525-97a0-d98139138e54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:10.003278 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f7b8439-12f7-4525-97a0-d98139138e54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:10.003727 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f7b8439-12f7-4525-97a0-d98139138e54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:10.004448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f7b8439-12f7-4525-97a0-d98139138e54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:10.004914 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f7b8439-12f7-4525-97a0-d98139138e54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:10.005346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-8f7b8439-12f7-4525-97a0-d98139138e54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:10.022091 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-8f7b8439-12f7-4525-97a0-d98139138e54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] HTTP exception thrown: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8f7b8439-12f7-4525-97a0-d98139138e54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Request method failure captured: Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: DELETE /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 HTTP/1.1 Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLb5X-yhpnzm_-dStJA8fy45iASzeRii36n72gOkSoH7IIyvY4Rj5v3-46JcJoog3Lu0Qjih9tyWvND7sey35jZRAzb0eX474-mOZiteIYlM7ln0VX-gf7U0HLuwt4nTsLITevLOMOW1NNY8o_rwW8qIlw6jtu_kY8zTy9HyZPbkMPPQ Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 403c04c19c0c45398d6b232c03a4b7a6 Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:15:10.023669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:15:10.025231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_403c04c19c0c45398d6b232c03a4b7a6"}]}] Sep 23 14:15:10.025231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:10.025231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 403c04c19c0c45398d6b232c03a4b7a6 Sep 23 14:15:10.025231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:10.025231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-AttachVolumeTestJSON-748341513-project Sep 23 14:15:10.025231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:15:10.025231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:15:10.025231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 1e18b5b70f8b4939bebae2d7ef261740 Sep 23 14:15:10.025231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-AttachVolumeTestJSON-748341513-project Sep 23 14:15:10.025231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:15:10.025231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:15:10.025231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '13eef24f-a406-4677-9362-460ce72549d8'} Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:15:10.026229 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:15:10.028087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:15:10.030120 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-8f7b8439-12f7-4525-97a0-d98139138e54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Returning 404 to user: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:15:10.030120 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-8f7b8439-12f7-4525-97a0-d98139138e54 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "DELETE /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 404 len: 111 microversion: 2.1 time: 0.035140 Sep 23 14:15:10.030120 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 513/1023] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:15:09 2022] DELETE /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:15:10.034602 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-600798e4-3498-41fd-9656-49d624cc2387 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:15:10.035252 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-600798e4-3498-41fd-9656-49d624cc2387 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] [instance: 13eef24f-a406-4677-9362-460ce72549d8] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:15:10.041611 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-600798e4-3498-41fd-9656-49d624cc2387 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:10.042099 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-600798e4-3498-41fd-9656-49d624cc2387 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:10.042576 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-600798e4-3498-41fd-9656-49d624cc2387 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:10.043588 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-600798e4-3498-41fd-9656-49d624cc2387 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:15:10.044044 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-600798e4-3498-41fd-9656-49d624cc2387 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:15:10.044473 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-600798e4-3498-41fd-9656-49d624cc2387 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:15:10.058121 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-600798e4-3498-41fd-9656-49d624cc2387 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] HTTP exception thrown: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-600798e4-3498-41fd-9656-49d624cc2387 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Request method failure captured: Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 HTTP/1.1 Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLb5X-yhpnzm_-dStJA8fy45iASzeRii36n72gOkSoH7IIyvY4Rj5v3-46JcJoog3Lu0Qjih9tyWvND7sey35jZRAzb0eX474-mOZiteIYlM7ln0VX-gf7U0HLuwt4nTsLITevLOMOW1NNY8o_rwW8qIlw6jtu_kY8zTy9HyZPbkMPPQ Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 403c04c19c0c45398d6b232c03a4b7a6 Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:15:10.060449 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:15:10.062211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/403c04c19c0c45398d6b232c03a4b7a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_403c04c19c0c45398d6b232c03a4b7a6"}]}] Sep 23 14:15:10.062211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:10.062211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 403c04c19c0c45398d6b232c03a4b7a6 Sep 23 14:15:10.062211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-AttachVolumeTestJSON-748341513 Sep 23 14:15:10.062211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-AttachVolumeTestJSON-748341513-project Sep 23 14:15:10.062211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:15:10.062211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:15:10.062211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 1e18b5b70f8b4939bebae2d7ef261740 Sep 23 14:15:10.062211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-AttachVolumeTestJSON-748341513-project Sep 23 14:15:10.062211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:15:10.062211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:15:10.062211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': '13eef24f-a406-4677-9362-460ce72549d8'} Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:15:10.063484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. Sep 23 14:15:10.064969 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:15:10.066506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-600798e4-3498-41fd-9656-49d624cc2387 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] Returning 404 to user: Instance 13eef24f-a406-4677-9362-460ce72549d8 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:15:10.066506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-600798e4-3498-41fd-9656-49d624cc2387 tempest-AttachVolumeTestJSON-748341513 tempest-AttachVolumeTestJSON-748341513-project] 10.222.0.62 "GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8" status: 404 len: 111 microversion: 2.1 time: 0.031219 Sep 23 14:15:10.066506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 511/1024] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:15:10 2022] GET /compute/v2.1/servers/13eef24f-a406-4677-9362-460ce72549d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:16:42.867128 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:16:42.867885 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:16:42.869016 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 14:16:42.869160 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Fri Sep 23 14:16:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.62) !!! Sep 23 14:16:42.870146 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 14:16:42.870289 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Fri Sep 23 14:16:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.62) !!! Sep 23 14:16:42.874245 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-925169825", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "networks": [{"uuid": "b87122fb-88de-4bd4-9f1b-02007d3ac64f"}]}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:16:42.930502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.network.neutron [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] validate_networks() for [('b87122fb-88de-4bd4-9f1b-02007d3ac64f', None, None, None, None, None)] {{(pid=121073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:16:43.345236 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Flavor limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:16:43.345663 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Image limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:16:43.346143 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Flavor pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:16:43.346581 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Image pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:16:43.347001 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:16:43.356345 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:43.356834 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:43.357276 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:43.358011 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:43.358506 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:43.358940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:43.376500 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Getting quotas for project 01e7888a20c74078b4cb6cb8d6d44899. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:16:43.380416 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Getting quotas for user 5da7f8c9045041a784d22edfe323716c and project 01e7888a20c74078b4cb6cb8d6d44899. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:16:43.392134 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Going to run 1 instances... {{(pid=121073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:16:43.394509 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:16:43.509285 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-32b08fdb-2841-40fd-af8d-44e92452760c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644132 Sep 23 14:16:43.509928 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 514/1025] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:16:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 14:16:43.519695 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR oslo.messaging._drivers.impl_rabbit [-] [54bafbb0-812b-491c-8d88-d45e25df849b] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 14:16:43.520784 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:16:43.521530 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:16:43.522594 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 14:16:43.522768 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Fri Sep 23 14:16:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 (ip 10.222.0.62) !!! Sep 23 14:16:43.526993 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e2e55eae-f549-4e79-951d-cc3d174f85b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:16:43.527609 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e2e55eae-f549-4e79-951d-cc3d174f85b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:16:43.584329 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-e2e55eae-f549-4e79-951d-cc3d174f85b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:16:43.593006 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e2e55eae-f549-4e79-951d-cc3d174f85b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1218 microversion: 2.1 time: 0.074876 Sep 23 14:16:43.593243 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 512/1026] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:16:43 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:16:44.616038 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ad8e5589-5856-4ba0-bdb9-1a40e5522e70 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:16:44.616682 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ad8e5589-5856-4ba0-bdb9-1a40e5522e70 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:16:44.623908 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad8e5589-5856-4ba0-bdb9-1a40e5522e70 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:44.624402 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad8e5589-5856-4ba0-bdb9-1a40e5522e70 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:44.624835 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad8e5589-5856-4ba0-bdb9-1a40e5522e70 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:44.625525 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad8e5589-5856-4ba0-bdb9-1a40e5522e70 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:44.625990 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad8e5589-5856-4ba0-bdb9-1a40e5522e70 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:44.626448 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ad8e5589-5856-4ba0-bdb9-1a40e5522e70 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:44.690975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ad8e5589-5856-4ba0-bdb9-1a40e5522e70 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:16:44.699094 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ad8e5589-5856-4ba0-bdb9-1a40e5522e70 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1222 microversion: 2.1 time: 0.087758 Sep 23 14:16:44.704294 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 515/1027] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:16:44 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:16:45.723439 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fcae3ef8-c4ef-4b90-9861-b0050ddb6659 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:16:45.724080 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-fcae3ef8-c4ef-4b90-9861-b0050ddb6659 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:16:45.734501 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fcae3ef8-c4ef-4b90-9861-b0050ddb6659 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:45.734988 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fcae3ef8-c4ef-4b90-9861-b0050ddb6659 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:45.735430 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fcae3ef8-c4ef-4b90-9861-b0050ddb6659 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:45.736146 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fcae3ef8-c4ef-4b90-9861-b0050ddb6659 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:45.736588 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fcae3ef8-c4ef-4b90-9861-b0050ddb6659 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:45.737015 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fcae3ef8-c4ef-4b90-9861-b0050ddb6659 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:45.742756 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO oslo.messaging._drivers.impl_rabbit [-] [54bafbb0-812b-491c-8d88-d45e25df849b] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 50742. Sep 23 14:16:45.800743 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fcae3ef8-c4ef-4b90-9861-b0050ddb6659 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:16:45.808457 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fcae3ef8-c4ef-4b90-9861-b0050ddb6659 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1270 microversion: 2.1 time: 0.089534 Sep 23 14:16:45.809017 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 513/1028] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:16:45 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:16:46.834885 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-82ca965c-ee0e-4a87-8972-3ab41090fe0e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:16:46.835511 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-82ca965c-ee0e-4a87-8972-3ab41090fe0e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:16:46.842561 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-82ca965c-ee0e-4a87-8972-3ab41090fe0e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:46.843051 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-82ca965c-ee0e-4a87-8972-3ab41090fe0e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:46.843484 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-82ca965c-ee0e-4a87-8972-3ab41090fe0e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:46.844175 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-82ca965c-ee0e-4a87-8972-3ab41090fe0e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:46.844631 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-82ca965c-ee0e-4a87-8972-3ab41090fe0e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:46.845055 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-82ca965c-ee0e-4a87-8972-3ab41090fe0e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:46.980926 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-82ca965c-ee0e-4a87-8972-3ab41090fe0e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:16:46.988550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-82ca965c-ee0e-4a87-8972-3ab41090fe0e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1318 microversion: 2.1 time: 0.157643 Sep 23 14:16:46.989117 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 516/1029] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:16:46 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:16:47.745038 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-4eda7f91-6e39-454d-8b9b-21ff2812b48c req-c48fd76e-53e0-4b6c-aa0c-bbadc5e67369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50212f1-5bcd-4770-b65f-5c29f5738b54", "tag": "5810d767-b9e9-45bb-b14e-11af1fae5447"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:16:47.755104 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-4eda7f91-6e39-454d-8b9b-21ff2812b48c req-c48fd76e-53e0-4b6c-aa0c-bbadc5e67369 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:47.755588 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-4eda7f91-6e39-454d-8b9b-21ff2812b48c req-c48fd76e-53e0-4b6c-aa0c-bbadc5e67369 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:47.756024 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-4eda7f91-6e39-454d-8b9b-21ff2812b48c req-c48fd76e-53e0-4b6c-aa0c-bbadc5e67369 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:47.768110 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-4eda7f91-6e39-454d-8b9b-21ff2812b48c req-c48fd76e-53e0-4b6c-aa0c-bbadc5e67369 service nova] Creating event network-changed:5810d767-b9e9-45bb-b14e-11af1fae5447 for instance d50212f1-5bcd-4770-b65f-5c29f5738b54 on hv-cinder-85743 Sep 23 14:16:47.773094 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-4eda7f91-6e39-454d-8b9b-21ff2812b48c req-c48fd76e-53e0-4b6c-aa0c-bbadc5e67369 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032281 Sep 23 14:16:47.773992 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 514/1030] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:16:48.012065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-12a4a2b1-e3f1-4cc5-9531-03c81486e5e9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:16:48.012679 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-12a4a2b1-e3f1-4cc5-9531-03c81486e5e9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:16:48.019066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-12a4a2b1-e3f1-4cc5-9531-03c81486e5e9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:48.019550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-12a4a2b1-e3f1-4cc5-9531-03c81486e5e9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:48.019988 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-12a4a2b1-e3f1-4cc5-9531-03c81486e5e9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:48.020683 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-12a4a2b1-e3f1-4cc5-9531-03c81486e5e9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:48.021141 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-12a4a2b1-e3f1-4cc5-9531-03c81486e5e9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:48.021567 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-12a4a2b1-e3f1-4cc5-9531-03c81486e5e9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:48.150804 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-12a4a2b1-e3f1-4cc5-9531-03c81486e5e9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:16:48.158437 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-12a4a2b1-e3f1-4cc5-9531-03c81486e5e9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1318 microversion: 2.1 time: 0.150842 Sep 23 14:16:48.159000 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 517/1031] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:16:48 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:16:49.182128 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-2c903503-ccee-469f-ab56-a5b74d4e163f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:16:49.182865 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-2c903503-ccee-469f-ab56-a5b74d4e163f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:16:49.189013 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2c903503-ccee-469f-ab56-a5b74d4e163f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:49.189498 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2c903503-ccee-469f-ab56-a5b74d4e163f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:49.189936 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2c903503-ccee-469f-ab56-a5b74d4e163f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:49.190647 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2c903503-ccee-469f-ab56-a5b74d4e163f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:49.191105 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2c903503-ccee-469f-ab56-a5b74d4e163f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:49.191535 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-2c903503-ccee-469f-ab56-a5b74d4e163f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:49.321493 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-2c903503-ccee-469f-ab56-a5b74d4e163f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:16:49.329361 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-2c903503-ccee-469f-ab56-a5b74d4e163f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1318 microversion: 2.1 time: 0.152039 Sep 23 14:16:49.329935 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 515/1032] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:16:49 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:16:50.352772 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-11ebb455-473e-4ea7-b015-b7dcba295120 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:16:50.353315 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-11ebb455-473e-4ea7-b015-b7dcba295120 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:16:50.359878 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-11ebb455-473e-4ea7-b015-b7dcba295120 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:50.360365 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-11ebb455-473e-4ea7-b015-b7dcba295120 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:50.360803 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-11ebb455-473e-4ea7-b015-b7dcba295120 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:50.361486 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-11ebb455-473e-4ea7-b015-b7dcba295120 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:50.361941 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-11ebb455-473e-4ea7-b015-b7dcba295120 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:50.362384 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-11ebb455-473e-4ea7-b015-b7dcba295120 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:50.489725 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-11ebb455-473e-4ea7-b015-b7dcba295120 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:16:50.497905 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-11ebb455-473e-4ea7-b015-b7dcba295120 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1318 microversion: 2.1 time: 0.149779 Sep 23 14:16:50.498488 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 518/1033] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:16:50 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:16:51.521398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-78047e27-c92a-4966-816b-b1f094b02c30 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:16:51.521941 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-78047e27-c92a-4966-816b-b1f094b02c30 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:16:51.528723 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-78047e27-c92a-4966-816b-b1f094b02c30 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:51.529201 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-78047e27-c92a-4966-816b-b1f094b02c30 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:51.529633 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-78047e27-c92a-4966-816b-b1f094b02c30 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:51.530315 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-78047e27-c92a-4966-816b-b1f094b02c30 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:51.530786 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-78047e27-c92a-4966-816b-b1f094b02c30 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:51.531214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-78047e27-c92a-4966-816b-b1f094b02c30 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:51.655603 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-78047e27-c92a-4966-816b-b1f094b02c30 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:16:51.663120 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-78047e27-c92a-4966-816b-b1f094b02c30 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1318 microversion: 2.1 time: 0.145985 Sep 23 14:16:51.663674 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 516/1034] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:16:51 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:16:52.686672 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-220c61d8-4a85-462c-bcfc-1bc95f61ee87 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:16:52.687278 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-220c61d8-4a85-462c-bcfc-1bc95f61ee87 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:16:52.693569 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-220c61d8-4a85-462c-bcfc-1bc95f61ee87 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:52.694055 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-220c61d8-4a85-462c-bcfc-1bc95f61ee87 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:52.694529 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-220c61d8-4a85-462c-bcfc-1bc95f61ee87 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:52.695325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-220c61d8-4a85-462c-bcfc-1bc95f61ee87 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:52.695780 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-220c61d8-4a85-462c-bcfc-1bc95f61ee87 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:52.696203 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-220c61d8-4a85-462c-bcfc-1bc95f61ee87 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:52.823249 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-220c61d8-4a85-462c-bcfc-1bc95f61ee87 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:16:52.831636 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-220c61d8-4a85-462c-bcfc-1bc95f61ee87 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1318 microversion: 2.1 time: 0.148627 Sep 23 14:16:52.832551 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 519/1035] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:16:52 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:16:53.036167 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-f85b476a-bbec-4535-9e48-26540038619e req-7d6570db-9699-409c-9028-55127a1b1171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50212f1-5bcd-4770-b65f-5c29f5738b54", "name": "network-vif-plugged", "status": "completed", "tag": "5810d767-b9e9-45bb-b14e-11af1fae5447"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:16:53.046786 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f85b476a-bbec-4535-9e48-26540038619e req-7d6570db-9699-409c-9028-55127a1b1171 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:53.047264 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f85b476a-bbec-4535-9e48-26540038619e req-7d6570db-9699-409c-9028-55127a1b1171 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:53.047696 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-f85b476a-bbec-4535-9e48-26540038619e req-7d6570db-9699-409c-9028-55127a1b1171 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:53.058472 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-f85b476a-bbec-4535-9e48-26540038619e req-7d6570db-9699-409c-9028-55127a1b1171 service nova] Creating event network-vif-plugged:5810d767-b9e9-45bb-b14e-11af1fae5447 for instance d50212f1-5bcd-4770-b65f-5c29f5738b54 on hv-cinder-85743 Sep 23 14:16:53.063440 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-f85b476a-bbec-4535-9e48-26540038619e req-7d6570db-9699-409c-9028-55127a1b1171 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030877 Sep 23 14:16:53.064307 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 517/1036] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:16:53.855264 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-26debc32-dbfb-48a3-8d2d-b7e036e2f322 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:16:53.855877 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-26debc32-dbfb-48a3-8d2d-b7e036e2f322 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:16:53.857714 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:16:53.858535 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=6 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:16:53.863571 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-26debc32-dbfb-48a3-8d2d-b7e036e2f322 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:53.864059 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-26debc32-dbfb-48a3-8d2d-b7e036e2f322 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:53.864499 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-26debc32-dbfb-48a3-8d2d-b7e036e2f322 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:53.865188 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-26debc32-dbfb-48a3-8d2d-b7e036e2f322 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:53.865647 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-26debc32-dbfb-48a3-8d2d-b7e036e2f322 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:53.866074 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-26debc32-dbfb-48a3-8d2d-b7e036e2f322 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:54.001767 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-26debc32-dbfb-48a3-8d2d-b7e036e2f322 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:16:54.010407 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-26debc32-dbfb-48a3-8d2d-b7e036e2f322 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1318 microversion: 2.1 time: 0.159036 Sep 23 14:16:54.010980 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 520/1037] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:16:53 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:16:55.030604 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:16:55.035328 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-25d51dfd-5817-4a6e-b84f-d7f0f896dc4a tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:16:55.036031 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-25d51dfd-5817-4a6e-b84f-d7f0f896dc4a tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:16:55.043553 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25d51dfd-5817-4a6e-b84f-d7f0f896dc4a tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:55.044044 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25d51dfd-5817-4a6e-b84f-d7f0f896dc4a tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:55.044503 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25d51dfd-5817-4a6e-b84f-d7f0f896dc4a tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:55.045185 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25d51dfd-5817-4a6e-b84f-d7f0f896dc4a tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:55.045649 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25d51dfd-5817-4a6e-b84f-d7f0f896dc4a tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:55.046080 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25d51dfd-5817-4a6e-b84f-d7f0f896dc4a tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:55.179269 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-25d51dfd-5817-4a6e-b84f-d7f0f896dc4a tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:16:55.188275 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-25d51dfd-5817-4a6e-b84f-d7f0f896dc4a tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1318 microversion: 2.1 time: 0.158795 Sep 23 14:16:55.188862 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 518/1038] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:16:55 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:16:56.211182 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3d56306f-2cdc-4430-8511-d71e0d10caea tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:16:56.212320 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3d56306f-2cdc-4430-8511-d71e0d10caea tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:16:56.219005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3d56306f-2cdc-4430-8511-d71e0d10caea tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:56.219489 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3d56306f-2cdc-4430-8511-d71e0d10caea tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:56.219930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3d56306f-2cdc-4430-8511-d71e0d10caea tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:56.220625 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3d56306f-2cdc-4430-8511-d71e0d10caea tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:16:56.221086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3d56306f-2cdc-4430-8511-d71e0d10caea tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:16:56.221508 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3d56306f-2cdc-4430-8511-d71e0d10caea tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:16:56.354241 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3d56306f-2cdc-4430-8511-d71e0d10caea tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:16:56.361937 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3d56306f-2cdc-4430-8511-d71e0d10caea tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1506 microversion: 2.1 time: 0.154636 Sep 23 14:16:56.362525 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 521/1039] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:16:56 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:17:12.947086 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4385f4ef-6fbb-4340-a912-5c8d1201d24e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af36bdb7-f772-4c29-a7e8-2aab426e7842", "device": "/dev/sdb"}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:17:12.950513 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4385f4ef-6fbb-4340-a912-5c8d1201d24e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:17:12.956953 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=16 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:17:12.957646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=28 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:17:12.959471 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4385f4ef-6fbb-4340-a912-5c8d1201d24e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:12.959959 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4385f4ef-6fbb-4340-a912-5c8d1201d24e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:12.960523 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4385f4ef-6fbb-4340-a912-5c8d1201d24e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:12.961184 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4385f4ef-6fbb-4340-a912-5c8d1201d24e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:12.961638 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4385f4ef-6fbb-4340-a912-5c8d1201d24e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:12.962055 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4385f4ef-6fbb-4340-a912-5c8d1201d24e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:13.925078 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4385f4ef-6fbb-4340-a912-5c8d1201d24e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "POST /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.981791 Sep 23 14:17:13.925726 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 519/1040] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 23 14:17:12 2022] POST /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54/os-volume_attachments => generated 194 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:17:38.654944 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-45d5c046-f9b2-4f58-8ad8-440d7f4ace5f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:17:38.655486 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-45d5c046-f9b2-4f58-8ad8-440d7f4ace5f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:17:38.657601 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:17:38.658257 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=44 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:17:38.663891 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-45d5c046-f9b2-4f58-8ad8-440d7f4ace5f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:38.664375 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-45d5c046-f9b2-4f58-8ad8-440d7f4ace5f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:38.664816 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-45d5c046-f9b2-4f58-8ad8-440d7f4ace5f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:38.665499 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-45d5c046-f9b2-4f58-8ad8-440d7f4ace5f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:38.665952 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-45d5c046-f9b2-4f58-8ad8-440d7f4ace5f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:38.666397 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-45d5c046-f9b2-4f58-8ad8-440d7f4ace5f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:38.799759 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-45d5c046-f9b2-4f58-8ad8-440d7f4ace5f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lazy-loading 'services' on Instance uuid d50212f1-5bcd-4770-b65f-5c29f5738b54 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:17:39.050057 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-45d5c046-f9b2-4f58-8ad8-440d7f4ace5f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54/os-volume_attachments/af36bdb7-f772-4c29-a7e8-2aab426e7842" status: 202 len: 0 microversion: 2.1 time: 0.398861 Sep 23 14:17:39.050674 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 522/1041] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 23 14:17:38 2022] DELETE /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54/os-volume_attachments/af36bdb7-f772-4c29-a7e8-2aab426e7842 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:17:41.244062 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-69ad7701-e842-4a18-be3a-81987fee0c27 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:17:41.244644 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-69ad7701-e842-4a18-be3a-81987fee0c27 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:17:41.246726 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:17:41.247512 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:17:41.252313 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-69ad7701-e842-4a18-be3a-81987fee0c27 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:41.252797 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-69ad7701-e842-4a18-be3a-81987fee0c27 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:41.253238 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-69ad7701-e842-4a18-be3a-81987fee0c27 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:41.253925 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-69ad7701-e842-4a18-be3a-81987fee0c27 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:41.254454 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-69ad7701-e842-4a18-be3a-81987fee0c27 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:41.254889 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-69ad7701-e842-4a18-be3a-81987fee0c27 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:41.279834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-69ad7701-e842-4a18-be3a-81987fee0c27 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Going to try to terminate instance {{(pid=121074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:17:41.513484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-69ad7701-e842-4a18-be3a-81987fee0c27 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 204 len: 0 microversion: 2.1 time: 0.274153 Sep 23 14:17:41.514070 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 520/1042] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:17:41 2022] DELETE /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:17:41.523807 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-155caf02-1114-44ac-9c23-5532c961b99c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:17:41.524520 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-155caf02-1114-44ac-9c23-5532c961b99c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:17:41.530679 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-155caf02-1114-44ac-9c23-5532c961b99c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:41.531175 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-155caf02-1114-44ac-9c23-5532c961b99c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:41.531618 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-155caf02-1114-44ac-9c23-5532c961b99c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:41.532312 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-155caf02-1114-44ac-9c23-5532c961b99c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:41.532795 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-155caf02-1114-44ac-9c23-5532c961b99c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:41.533233 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-155caf02-1114-44ac-9c23-5532c961b99c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:41.662528 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-155caf02-1114-44ac-9c23-5532c961b99c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:17:41.670374 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-155caf02-1114-44ac-9c23-5532c961b99c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1512 microversion: 2.1 time: 0.151813 Sep 23 14:17:41.670940 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 523/1043] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:17:41 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:17:42.693666 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7b0b1fc0-49f3-477e-867f-87946ec34a17 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:17:42.694312 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7b0b1fc0-49f3-477e-867f-87946ec34a17 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:17:42.700655 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7b0b1fc0-49f3-477e-867f-87946ec34a17 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:42.701138 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7b0b1fc0-49f3-477e-867f-87946ec34a17 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:42.701604 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7b0b1fc0-49f3-477e-867f-87946ec34a17 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:42.702289 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7b0b1fc0-49f3-477e-867f-87946ec34a17 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:42.702805 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7b0b1fc0-49f3-477e-867f-87946ec34a17 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:42.703233 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7b0b1fc0-49f3-477e-867f-87946ec34a17 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:42.831917 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7b0b1fc0-49f3-477e-867f-87946ec34a17 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:17:42.839661 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7b0b1fc0-49f3-477e-867f-87946ec34a17 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1512 microversion: 2.1 time: 0.150278 Sep 23 14:17:42.840237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 521/1044] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:17:42 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:17:43.862351 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-2de64e20-943e-4e3d-bad5-586a158fad28 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:17:43.862912 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-2de64e20-943e-4e3d-bad5-586a158fad28 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:17:43.871606 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2de64e20-943e-4e3d-bad5-586a158fad28 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:43.874168 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2de64e20-943e-4e3d-bad5-586a158fad28 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:43.874168 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2de64e20-943e-4e3d-bad5-586a158fad28 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:43.874168 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2de64e20-943e-4e3d-bad5-586a158fad28 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:43.874168 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2de64e20-943e-4e3d-bad5-586a158fad28 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:43.874639 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2de64e20-943e-4e3d-bad5-586a158fad28 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:43.943233 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-2de64e20-943e-4e3d-bad5-586a158fad28 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:17:43.950967 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-2de64e20-943e-4e3d-bad5-586a158fad28 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1470 microversion: 2.1 time: 0.092684 Sep 23 14:17:43.951533 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 524/1045] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:17:43 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1470 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:17:43.981185 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-be57d4bc-235b-4c40-b513-f97c8dc66275 req-8c66985f-13f7-48e2-bd86-0960a17c57d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50212f1-5bcd-4770-b65f-5c29f5738b54", "name": "network-vif-deleted", "tag": "5810d767-b9e9-45bb-b14e-11af1fae5447"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:17:43.991484 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-be57d4bc-235b-4c40-b513-f97c8dc66275 req-8c66985f-13f7-48e2-bd86-0960a17c57d4 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:43.994443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-be57d4bc-235b-4c40-b513-f97c8dc66275 req-8c66985f-13f7-48e2-bd86-0960a17c57d4 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:43.994443 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-be57d4bc-235b-4c40-b513-f97c8dc66275 req-8c66985f-13f7-48e2-bd86-0960a17c57d4 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:44.003051 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-be57d4bc-235b-4c40-b513-f97c8dc66275 req-8c66985f-13f7-48e2-bd86-0960a17c57d4 service nova] Creating event network-vif-deleted:5810d767-b9e9-45bb-b14e-11af1fae5447 for instance d50212f1-5bcd-4770-b65f-5c29f5738b54 on hv-cinder-85743 Sep 23 14:17:44.008616 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-be57d4bc-235b-4c40-b513-f97c8dc66275 req-8c66985f-13f7-48e2-bd86-0960a17c57d4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031027 Sep 23 14:17:44.009235 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 522/1046] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:17:44.973194 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-658b6c45-f49f-44a6-914f-8b73b1efd034 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:17:44.973990 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-658b6c45-f49f-44a6-914f-8b73b1efd034 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:17:44.980407 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-658b6c45-f49f-44a6-914f-8b73b1efd034 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:44.980898 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-658b6c45-f49f-44a6-914f-8b73b1efd034 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:44.981337 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-658b6c45-f49f-44a6-914f-8b73b1efd034 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:44.982034 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-658b6c45-f49f-44a6-914f-8b73b1efd034 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:44.982532 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-658b6c45-f49f-44a6-914f-8b73b1efd034 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:44.982961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-658b6c45-f49f-44a6-914f-8b73b1efd034 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:45.014147 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-658b6c45-f49f-44a6-914f-8b73b1efd034 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:45.014669 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-658b6c45-f49f-44a6-914f-8b73b1efd034 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:45.015110 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-658b6c45-f49f-44a6-914f-8b73b1efd034 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:45.015653 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-658b6c45-f49f-44a6-914f-8b73b1efd034 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lazy-loading 'fault' on Instance uuid d50212f1-5bcd-4770-b65f-5c29f5738b54 {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:17:45.057617 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-658b6c45-f49f-44a6-914f-8b73b1efd034 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:17:45.065361 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-658b6c45-f49f-44a6-914f-8b73b1efd034 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 200 len: 1308 microversion: 2.1 time: 0.096153 Sep 23 14:17:45.065935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 525/1047] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:17:44 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:17:46.090368 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-320f4bfb-f23b-4e6a-962d-78d52ac9c597 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:17:46.091072 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-320f4bfb-f23b-4e6a-962d-78d52ac9c597 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: d50212f1-5bcd-4770-b65f-5c29f5738b54] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:17:46.097315 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-320f4bfb-f23b-4e6a-962d-78d52ac9c597 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:46.097800 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-320f4bfb-f23b-4e6a-962d-78d52ac9c597 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:46.098240 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-320f4bfb-f23b-4e6a-962d-78d52ac9c597 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:46.099754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-320f4bfb-f23b-4e6a-962d-78d52ac9c597 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:46.100219 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-320f4bfb-f23b-4e6a-962d-78d52ac9c597 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:46.100651 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-320f4bfb-f23b-4e6a-962d-78d52ac9c597 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:46.113469 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-320f4bfb-f23b-4e6a-962d-78d52ac9c597 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] HTTP exception thrown: Instance d50212f1-5bcd-4770-b65f-5c29f5738b54 could not be found. Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-320f4bfb-f23b-4e6a-962d-78d52ac9c597 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Request method failure captured: Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 HTTP/1.1 Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLb_JnIZi-2nNQB5N_p7ysnehCxkUaSC8a6zhlP4-OvEpK-pSaFHLeH5SnnGH6f6uwubpon43brifNuQen6o1HMpsEaX07xFMem3XnQQhBYRKPnz6vSOZHHNiaVw8Kg82Plkjifn3pCHxeQ7GOxLPatOLmFvs3d39khpxjWOB_l1Ncts Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 01e7888a20c74078b4cb6cb8d6d44899 Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-VolumesSnapshotTestJSON-629636169 Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:17:46.115293 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:17:46.117061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/01e7888a20c74078b4cb6cb8d6d44899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/01e7888a20c74078b4cb6cb8d6d44899"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/01e7888a20c74078b4cb6cb8d6d44899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_01e7888a20c74078b4cb6cb8d6d44899"}]}] Sep 23 14:17:46.117061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-VolumesSnapshotTestJSON-629636169 Sep 23 14:17:46.117061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 01e7888a20c74078b4cb6cb8d6d44899 Sep 23 14:17:46.117061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-629636169 Sep 23 14:17:46.117061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-VolumesSnapshotTestJSON-629636169-project Sep 23 14:17:46.117061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:17:46.117061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:17:46.117061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 5da7f8c9045041a784d22edfe323716c Sep 23 14:17:46.117061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-VolumesSnapshotTestJSON-629636169-project Sep 23 14:17:46.117061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:17:46.117061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance d50212f1-5bcd-4770-b65f-5c29f5738b54 could not be found. Sep 23 14:17:46.117061 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'id': 'd50212f1-5bcd-4770-b65f-5c29f5738b54'} Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50212f1-5bcd-4770-b65f-5c29f5738b54 could not be found. Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:17:46.118214 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50212f1-5bcd-4770-b65f-5c29f5738b54 could not be found. Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50212f1-5bcd-4770-b65f-5c29f5738b54 could not be found. Sep 23 14:17:46.119851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:17:46.121439 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-320f4bfb-f23b-4e6a-962d-78d52ac9c597 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Returning 404 to user: Instance d50212f1-5bcd-4770-b65f-5c29f5738b54 could not be found. {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:17:46.121439 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-320f4bfb-f23b-4e6a-962d-78d52ac9c597 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54" status: 404 len: 111 microversion: 2.1 time: 0.030718 Sep 23 14:17:46.121439 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 523/1048] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:17:46 2022] GET /compute/v2.1/servers/d50212f1-5bcd-4770-b65f-5c29f5738b54 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:17:56.468864 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-406557839", "imageRef": "f19afda2-139e-4a70-8e47-023a4884d613", "flavorRef": "452", "networks": [{"uuid": "b87122fb-88de-4bd4-9f1b-02007d3ac64f"}]}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:17:56.478897 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=10 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:17:56.479563 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:17:56.525297 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.network.neutron [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] validate_networks() for [('b87122fb-88de-4bd4-9f1b-02007d3ac64f', None, None, None, None, None)] {{(pid=121073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:17:56.869223 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Flavor limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:17:56.869675 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Image limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:17:56.870148 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Flavor pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:17:56.870583 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Image pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:17:56.870995 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:17:56.879474 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:56.879958 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:56.880390 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:56.881104 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:56.881557 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:56.882681 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:56.899583 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Getting quotas for project 01e7888a20c74078b4cb6cb8d6d44899. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:17:56.903478 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Getting quotas for user 5da7f8c9045041a784d22edfe323716c and project 01e7888a20c74078b4cb6cb8d6d44899. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:17:56.914454 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Going to run 1 instances... {{(pid=121073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:17:56.916693 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f19afda2-139e-4a70-8e47-023a4884d613',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:17:57.068236 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-304037e2-9350-4acc-b99c-5c86dfeced52 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603100 Sep 23 14:17:57.068969 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 526/1049] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:17:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 14:17:57.080181 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7f9adba9-eb2d-419f-a44a-576ddc50bc3c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:17:57.080796 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7f9adba9-eb2d-419f-a44a-576ddc50bc3c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:17:57.083337 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:17:57.084016 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:17:57.141281 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7f9adba9-eb2d-419f-a44a-576ddc50bc3c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:17:57.150396 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7f9adba9-eb2d-419f-a44a-576ddc50bc3c tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1218 microversion: 2.1 time: 0.073954 Sep 23 14:17:57.150956 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 524/1050] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:17:57 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:17:58.173608 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d2d53d55-78a4-4540-ab86-d57998717749 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:17:58.174242 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d2d53d55-78a4-4540-ab86-d57998717749 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:17:58.183057 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d2d53d55-78a4-4540-ab86-d57998717749 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:58.183543 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d2d53d55-78a4-4540-ab86-d57998717749 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:58.184007 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d2d53d55-78a4-4540-ab86-d57998717749 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:58.184719 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d2d53d55-78a4-4540-ab86-d57998717749 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:58.185172 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d2d53d55-78a4-4540-ab86-d57998717749 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:58.185597 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d2d53d55-78a4-4540-ab86-d57998717749 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:58.501170 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d2d53d55-78a4-4540-ab86-d57998717749 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:17:58.509593 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d2d53d55-78a4-4540-ab86-d57998717749 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1222 microversion: 2.1 time: 0.340375 Sep 23 14:17:58.510155 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 527/1051] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:17:58 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1222 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:17:59.533215 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b710a57a-a970-406c-9814-e6c0a14a4306 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:17:59.533806 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b710a57a-a970-406c-9814-e6c0a14a4306 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:17:59.541896 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b710a57a-a970-406c-9814-e6c0a14a4306 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:59.542405 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b710a57a-a970-406c-9814-e6c0a14a4306 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:59.542849 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b710a57a-a970-406c-9814-e6c0a14a4306 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:59.543535 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b710a57a-a970-406c-9814-e6c0a14a4306 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:17:59.543994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b710a57a-a970-406c-9814-e6c0a14a4306 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:17:59.544423 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b710a57a-a970-406c-9814-e6c0a14a4306 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:17:59.606271 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b710a57a-a970-406c-9814-e6c0a14a4306 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:17:59.615188 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b710a57a-a970-406c-9814-e6c0a14a4306 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1288 microversion: 2.1 time: 0.086454 Sep 23 14:17:59.615753 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 525/1052] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:17:59 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:18:00.641838 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-9178e46c-7e5c-4d25-8604-d183ebe580eb tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:00.642519 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-9178e46c-7e5c-4d25-8604-d183ebe580eb tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:00.649140 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9178e46c-7e5c-4d25-8604-d183ebe580eb tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:00.649627 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9178e46c-7e5c-4d25-8604-d183ebe580eb tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:00.650066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9178e46c-7e5c-4d25-8604-d183ebe580eb tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:00.650781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9178e46c-7e5c-4d25-8604-d183ebe580eb tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:00.651237 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9178e46c-7e5c-4d25-8604-d183ebe580eb tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:00.651660 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-9178e46c-7e5c-4d25-8604-d183ebe580eb tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:00.781955 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-9178e46c-7e5c-4d25-8604-d183ebe580eb tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:18:00.791083 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-9178e46c-7e5c-4d25-8604-d183ebe580eb tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1318 microversion: 2.1 time: 0.153109 Sep 23 14:18:00.791662 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 528/1053] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:18:00 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:18:01.019940 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-c8e9dc76-ec51-4814-9097-28cf470594b0 req-bf5f385a-ebb6-4b8a-a006-aa29ba6ca622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5674ce1b-ecff-4c2f-b008-1f3c47a5c541", "tag": "02418a3f-fa13-4e31-b1ef-6fd34f67862a"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:18:01.030470 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-c8e9dc76-ec51-4814-9097-28cf470594b0 req-bf5f385a-ebb6-4b8a-a006-aa29ba6ca622 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:01.034359 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-c8e9dc76-ec51-4814-9097-28cf470594b0 req-bf5f385a-ebb6-4b8a-a006-aa29ba6ca622 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:01.034359 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-c8e9dc76-ec51-4814-9097-28cf470594b0 req-bf5f385a-ebb6-4b8a-a006-aa29ba6ca622 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:01.045290 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-c8e9dc76-ec51-4814-9097-28cf470594b0 req-bf5f385a-ebb6-4b8a-a006-aa29ba6ca622 service nova] Creating event network-changed:02418a3f-fa13-4e31-b1ef-6fd34f67862a for instance 5674ce1b-ecff-4c2f-b008-1f3c47a5c541 on hv-cinder-85743 Sep 23 14:18:01.050239 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-c8e9dc76-ec51-4814-9097-28cf470594b0 req-bf5f385a-ebb6-4b8a-a006-aa29ba6ca622 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034033 Sep 23 14:18:01.050893 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 526/1054] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:18:01.814723 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-27972adb-fc94-4bf6-814a-8c5543cfc9f1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:01.815502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-27972adb-fc94-4bf6-814a-8c5543cfc9f1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:01.821773 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27972adb-fc94-4bf6-814a-8c5543cfc9f1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:01.822260 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27972adb-fc94-4bf6-814a-8c5543cfc9f1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:01.822726 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27972adb-fc94-4bf6-814a-8c5543cfc9f1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:01.823416 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27972adb-fc94-4bf6-814a-8c5543cfc9f1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:01.823894 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27972adb-fc94-4bf6-814a-8c5543cfc9f1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:01.824299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-27972adb-fc94-4bf6-814a-8c5543cfc9f1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:01.953218 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-27972adb-fc94-4bf6-814a-8c5543cfc9f1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:18:01.961408 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-27972adb-fc94-4bf6-814a-8c5543cfc9f1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1318 microversion: 2.1 time: 0.150064 Sep 23 14:18:01.961976 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 529/1055] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:18:01 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:18:02.985320 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7e4b4046-fc04-41f1-b75f-f9940d592f31 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:02.986013 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7e4b4046-fc04-41f1-b75f-f9940d592f31 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:02.993145 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7e4b4046-fc04-41f1-b75f-f9940d592f31 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:02.993630 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7e4b4046-fc04-41f1-b75f-f9940d592f31 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:02.994067 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7e4b4046-fc04-41f1-b75f-f9940d592f31 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:02.994789 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7e4b4046-fc04-41f1-b75f-f9940d592f31 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:02.995247 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7e4b4046-fc04-41f1-b75f-f9940d592f31 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:02.995673 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7e4b4046-fc04-41f1-b75f-f9940d592f31 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:03.120772 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7e4b4046-fc04-41f1-b75f-f9940d592f31 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:18:03.128289 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7e4b4046-fc04-41f1-b75f-f9940d592f31 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1318 microversion: 2.1 time: 0.147652 Sep 23 14:18:03.128852 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 527/1056] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:18:02 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:18:04.151475 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-df6277b8-7708-49b3-89c8-b9d0f55eea89 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:04.152328 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-df6277b8-7708-49b3-89c8-b9d0f55eea89 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:04.162760 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-df6277b8-7708-49b3-89c8-b9d0f55eea89 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:04.163256 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-df6277b8-7708-49b3-89c8-b9d0f55eea89 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:04.164300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-df6277b8-7708-49b3-89c8-b9d0f55eea89 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:04.165008 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-df6277b8-7708-49b3-89c8-b9d0f55eea89 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:04.165464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-df6277b8-7708-49b3-89c8-b9d0f55eea89 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:04.165889 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-df6277b8-7708-49b3-89c8-b9d0f55eea89 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:04.300096 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-df6277b8-7708-49b3-89c8-b9d0f55eea89 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:18:04.308241 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-df6277b8-7708-49b3-89c8-b9d0f55eea89 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1318 microversion: 2.1 time: 0.161502 Sep 23 14:18:04.308814 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 530/1057] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:18:04 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:18:05.331947 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-405cfd2a-3e9c-4be7-b429-f191d379654b tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:05.332624 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-405cfd2a-3e9c-4be7-b429-f191d379654b tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:05.338953 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-405cfd2a-3e9c-4be7-b429-f191d379654b tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:05.339431 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-405cfd2a-3e9c-4be7-b429-f191d379654b tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:05.339865 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-405cfd2a-3e9c-4be7-b429-f191d379654b tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:05.340540 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-405cfd2a-3e9c-4be7-b429-f191d379654b tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:05.340989 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-405cfd2a-3e9c-4be7-b429-f191d379654b tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:05.341406 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-405cfd2a-3e9c-4be7-b429-f191d379654b tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:05.501434 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-405cfd2a-3e9c-4be7-b429-f191d379654b tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:18:05.501434 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-405cfd2a-3e9c-4be7-b429-f191d379654b tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1318 microversion: 2.1 time: 0.152637 Sep 23 14:18:05.501434 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 528/1058] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:18:05 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:18:05.723353 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-cd11b071-c072-4b28-b50b-a82ac3164fd6 req-683be896-b6c8-4b95-8f69-72b13a440df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5674ce1b-ecff-4c2f-b008-1f3c47a5c541", "name": "network-vif-plugged", "status": "completed", "tag": "02418a3f-fa13-4e31-b1ef-6fd34f67862a"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:18:05.734025 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-cd11b071-c072-4b28-b50b-a82ac3164fd6 req-683be896-b6c8-4b95-8f69-72b13a440df2 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:05.734621 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-cd11b071-c072-4b28-b50b-a82ac3164fd6 req-683be896-b6c8-4b95-8f69-72b13a440df2 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:05.735048 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-cd11b071-c072-4b28-b50b-a82ac3164fd6 req-683be896-b6c8-4b95-8f69-72b13a440df2 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:05.745557 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-cd11b071-c072-4b28-b50b-a82ac3164fd6 req-683be896-b6c8-4b95-8f69-72b13a440df2 service nova] Creating event network-vif-plugged:02418a3f-fa13-4e31-b1ef-6fd34f67862a for instance 5674ce1b-ecff-4c2f-b008-1f3c47a5c541 on hv-cinder-85743 Sep 23 14:18:05.750668 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-cd11b071-c072-4b28-b50b-a82ac3164fd6 req-683be896-b6c8-4b95-8f69-72b13a440df2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031059 Sep 23 14:18:05.751325 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 531/1059] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:18:06.503369 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-fb83c070-707e-4d15-878b-b90f0753042d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:06.503977 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-fb83c070-707e-4d15-878b-b90f0753042d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:06.510937 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fb83c070-707e-4d15-878b-b90f0753042d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:06.511417 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fb83c070-707e-4d15-878b-b90f0753042d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:06.511847 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fb83c070-707e-4d15-878b-b90f0753042d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:06.512525 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fb83c070-707e-4d15-878b-b90f0753042d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:06.512994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fb83c070-707e-4d15-878b-b90f0753042d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:06.513396 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-fb83c070-707e-4d15-878b-b90f0753042d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:06.641871 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-fb83c070-707e-4d15-878b-b90f0753042d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:18:06.649365 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-fb83c070-707e-4d15-878b-b90f0753042d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1318 microversion: 2.1 time: 0.149831 Sep 23 14:18:06.649917 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 529/1060] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:18:06 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:18:07.670653 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:18:07.671428 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=6 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:18:07.675404 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4edfd252-d17a-4c7d-b56f-ef5157e980a1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:07.676095 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4edfd252-d17a-4c7d-b56f-ef5157e980a1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:07.682784 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4edfd252-d17a-4c7d-b56f-ef5157e980a1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:07.688348 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4edfd252-d17a-4c7d-b56f-ef5157e980a1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:07.688348 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4edfd252-d17a-4c7d-b56f-ef5157e980a1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:07.688348 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4edfd252-d17a-4c7d-b56f-ef5157e980a1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:07.688348 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4edfd252-d17a-4c7d-b56f-ef5157e980a1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:07.688843 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4edfd252-d17a-4c7d-b56f-ef5157e980a1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:07.816476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-4edfd252-d17a-4c7d-b56f-ef5157e980a1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:18:07.825162 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4edfd252-d17a-4c7d-b56f-ef5157e980a1 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1318 microversion: 2.1 time: 0.156060 Sep 23 14:18:07.826555 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 532/1061] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:18:07 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:18:08.848342 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-04eaf191-1ce3-4138-8e5f-0ee548c66344 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:08.848936 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-04eaf191-1ce3-4138-8e5f-0ee548c66344 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:08.850942 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=2 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:18:08.856149 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04eaf191-1ce3-4138-8e5f-0ee548c66344 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:08.856633 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04eaf191-1ce3-4138-8e5f-0ee548c66344 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:08.857070 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04eaf191-1ce3-4138-8e5f-0ee548c66344 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:08.857754 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04eaf191-1ce3-4138-8e5f-0ee548c66344 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:08.858240 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04eaf191-1ce3-4138-8e5f-0ee548c66344 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:08.858703 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-04eaf191-1ce3-4138-8e5f-0ee548c66344 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:08.985071 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-04eaf191-1ce3-4138-8e5f-0ee548c66344 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:18:08.992823 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-04eaf191-1ce3-4138-8e5f-0ee548c66344 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1506 microversion: 2.1 time: 0.148285 Sep 23 14:18:08.993390 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 530/1062] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:18:08 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:18:09.016652 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-4eccc99d-b720-4648-8f55-a847439b3d67 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bab6599-c869-4fd6-a966-245a21fca567", "device": "/dev/sdb"}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:18:09.019566 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-4eccc99d-b720-4648-8f55-a847439b3d67 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:09.026576 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4eccc99d-b720-4648-8f55-a847439b3d67 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:09.027062 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4eccc99d-b720-4648-8f55-a847439b3d67 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:09.027498 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4eccc99d-b720-4648-8f55-a847439b3d67 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:09.028189 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4eccc99d-b720-4648-8f55-a847439b3d67 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:09.028645 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4eccc99d-b720-4648-8f55-a847439b3d67 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:09.029073 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-4eccc99d-b720-4648-8f55-a847439b3d67 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:09.847465 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-4eccc99d-b720-4648-8f55-a847439b3d67 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "POST /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834560 Sep 23 14:18:09.848171 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 533/1063] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 23 14:18:09 2022] POST /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:18:29.712536 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ddee0e26-817e-4896-83f2-7545b2ed33c3 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:29.713771 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ddee0e26-817e-4896-83f2-7545b2ed33c3 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:29.716084 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=16 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:18:29.716789 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=32 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:18:29.717687 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 14:18:29.717821 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Fri Sep 23 14:18:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541/os-volume_attachments/0bab6599-c869-4fd6-a966-245a21fca567 (ip 10.222.0.62) !!! Sep 23 14:18:29.729481 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ddee0e26-817e-4896-83f2-7545b2ed33c3 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:29.729985 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ddee0e26-817e-4896-83f2-7545b2ed33c3 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:29.730479 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ddee0e26-817e-4896-83f2-7545b2ed33c3 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:29.731233 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ddee0e26-817e-4896-83f2-7545b2ed33c3 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:29.731686 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ddee0e26-817e-4896-83f2-7545b2ed33c3 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:29.732109 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ddee0e26-817e-4896-83f2-7545b2ed33c3 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:29.813282 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-ddee0e26-817e-4896-83f2-7545b2ed33c3 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lazy-loading 'services' on Instance uuid 5674ce1b-ecff-4c2f-b008-1f3c47a5c541 {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:18:30.017746 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ddee0e26-817e-4896-83f2-7545b2ed33c3 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541/os-volume_attachments/0bab6599-c869-4fd6-a966-245a21fca567" status: 202 len: 0 microversion: 2.1 time: 0.308987 Sep 23 14:18:30.018360 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 531/1064] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 23 14:18:29 2022] DELETE /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541/os-volume_attachments/0bab6599-c869-4fd6-a966-245a21fca567 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:18:31.141680 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-856aa3c5-b90b-49e7-a3a8-686f32ea252f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:31.142382 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-856aa3c5-b90b-49e7-a3a8-686f32ea252f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:31.145006 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:18:31.145754 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:18:31.152702 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-856aa3c5-b90b-49e7-a3a8-686f32ea252f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:31.153258 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-856aa3c5-b90b-49e7-a3a8-686f32ea252f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:31.153699 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-856aa3c5-b90b-49e7-a3a8-686f32ea252f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:31.154428 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-856aa3c5-b90b-49e7-a3a8-686f32ea252f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:31.154898 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-856aa3c5-b90b-49e7-a3a8-686f32ea252f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:31.155405 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-856aa3c5-b90b-49e7-a3a8-686f32ea252f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:31.182354 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-856aa3c5-b90b-49e7-a3a8-686f32ea252f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Going to try to terminate instance {{(pid=121073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:18:31.510860 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-856aa3c5-b90b-49e7-a3a8-686f32ea252f tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 204 len: 0 microversion: 2.1 time: 0.372724 Sep 23 14:18:31.511466 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 534/1065] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:18:31 2022] DELETE /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:18:31.520813 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-66a8e22f-05ba-4a66-ad6c-d8e62e5b322d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:31.521517 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-66a8e22f-05ba-4a66-ad6c-d8e62e5b322d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:31.528444 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66a8e22f-05ba-4a66-ad6c-d8e62e5b322d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:31.528928 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66a8e22f-05ba-4a66-ad6c-d8e62e5b322d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:31.529366 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66a8e22f-05ba-4a66-ad6c-d8e62e5b322d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:31.530052 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66a8e22f-05ba-4a66-ad6c-d8e62e5b322d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:31.530550 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66a8e22f-05ba-4a66-ad6c-d8e62e5b322d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:31.531371 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-66a8e22f-05ba-4a66-ad6c-d8e62e5b322d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:31.665194 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-66a8e22f-05ba-4a66-ad6c-d8e62e5b322d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:18:31.672867 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-66a8e22f-05ba-4a66-ad6c-d8e62e5b322d tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1512 microversion: 2.1 time: 0.156852 Sep 23 14:18:31.673441 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 532/1066] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:18:31 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:18:32.696949 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d4793ead-1123-444a-b521-6ffe9e46230e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:32.698231 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d4793ead-1123-444a-b521-6ffe9e46230e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:32.704827 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d4793ead-1123-444a-b521-6ffe9e46230e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:32.705348 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d4793ead-1123-444a-b521-6ffe9e46230e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:32.705785 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d4793ead-1123-444a-b521-6ffe9e46230e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:32.706515 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d4793ead-1123-444a-b521-6ffe9e46230e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:32.706975 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d4793ead-1123-444a-b521-6ffe9e46230e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:32.707405 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d4793ead-1123-444a-b521-6ffe9e46230e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:32.837446 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d4793ead-1123-444a-b521-6ffe9e46230e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:18:32.845825 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d4793ead-1123-444a-b521-6ffe9e46230e tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1512 microversion: 2.1 time: 0.153213 Sep 23 14:18:32.846400 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 535/1067] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:18:32 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:18:33.868612 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7ef98564-f699-4e8c-a2ef-7493fc4941e5 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:33.869808 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7ef98564-f699-4e8c-a2ef-7493fc4941e5 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:33.876229 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ef98564-f699-4e8c-a2ef-7493fc4941e5 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:33.876722 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ef98564-f699-4e8c-a2ef-7493fc4941e5 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:33.877162 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ef98564-f699-4e8c-a2ef-7493fc4941e5 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:33.877864 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ef98564-f699-4e8c-a2ef-7493fc4941e5 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:33.878351 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ef98564-f699-4e8c-a2ef-7493fc4941e5 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:33.878779 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7ef98564-f699-4e8c-a2ef-7493fc4941e5 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:34.013136 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7ef98564-f699-4e8c-a2ef-7493fc4941e5 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:18:34.020827 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7ef98564-f699-4e8c-a2ef-7493fc4941e5 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1512 microversion: 2.1 time: 0.156056 Sep 23 14:18:34.021405 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 533/1068] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:18:33 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:18:34.187925 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-17be5dfc-f31f-4d24-8a1c-9ff36501651b req-bc729b2a-4c49-4b0d-a68b-5e2b566e2ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5674ce1b-ecff-4c2f-b008-1f3c47a5c541", "name": "network-vif-deleted", "tag": "02418a3f-fa13-4e31-b1ef-6fd34f67862a"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:18:34.198961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-17be5dfc-f31f-4d24-8a1c-9ff36501651b req-bc729b2a-4c49-4b0d-a68b-5e2b566e2ee7 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:34.202242 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-17be5dfc-f31f-4d24-8a1c-9ff36501651b req-bc729b2a-4c49-4b0d-a68b-5e2b566e2ee7 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:34.202242 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-17be5dfc-f31f-4d24-8a1c-9ff36501651b req-bc729b2a-4c49-4b0d-a68b-5e2b566e2ee7 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:34.212047 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-17be5dfc-f31f-4d24-8a1c-9ff36501651b req-bc729b2a-4c49-4b0d-a68b-5e2b566e2ee7 service nova] Creating event network-vif-deleted:02418a3f-fa13-4e31-b1ef-6fd34f67862a for instance 5674ce1b-ecff-4c2f-b008-1f3c47a5c541 on hv-cinder-85743 Sep 23 14:18:34.218230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-17be5dfc-f31f-4d24-8a1c-9ff36501651b req-bc729b2a-4c49-4b0d-a68b-5e2b566e2ee7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034360 Sep 23 14:18:34.219432 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 536/1069] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:18:35.044987 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4224c045-603a-42be-8bf1-bcc20ebb25ec tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:35.045593 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4224c045-603a-42be-8bf1-bcc20ebb25ec tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:35.051933 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4224c045-603a-42be-8bf1-bcc20ebb25ec tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:35.052408 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4224c045-603a-42be-8bf1-bcc20ebb25ec tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:35.052838 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4224c045-603a-42be-8bf1-bcc20ebb25ec tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:35.053515 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4224c045-603a-42be-8bf1-bcc20ebb25ec tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:35.053965 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4224c045-603a-42be-8bf1-bcc20ebb25ec tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:35.054435 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4224c045-603a-42be-8bf1-bcc20ebb25ec tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:35.085237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4224c045-603a-42be-8bf1-bcc20ebb25ec tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:35.085712 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4224c045-603a-42be-8bf1-bcc20ebb25ec tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:35.086146 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4224c045-603a-42be-8bf1-bcc20ebb25ec tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:35.086613 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-4224c045-603a-42be-8bf1-bcc20ebb25ec tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lazy-loading 'fault' on Instance uuid 5674ce1b-ecff-4c2f-b008-1f3c47a5c541 {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:18:35.130486 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4224c045-603a-42be-8bf1-bcc20ebb25ec tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da7f8c9045041a784d22edfe323716c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e7888a20c74078b4cb6cb8d6d44899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:18:35.138294 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4224c045-603a-42be-8bf1-bcc20ebb25ec tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 200 len: 1308 microversion: 2.1 time: 0.097837 Sep 23 14:18:35.141669 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 534/1070] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:18:35 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:18:36.162012 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5b817cb2-094f-4cb7-b075-4da431ca32b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:18:36.162794 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5b817cb2-094f-4cb7-b075-4da431ca32b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] [instance: 5674ce1b-ecff-4c2f-b008-1f3c47a5c541] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:18:36.169423 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5b817cb2-094f-4cb7-b075-4da431ca32b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:36.169898 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5b817cb2-094f-4cb7-b075-4da431ca32b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:36.170342 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5b817cb2-094f-4cb7-b075-4da431ca32b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:36.171029 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5b817cb2-094f-4cb7-b075-4da431ca32b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:18:36.171479 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5b817cb2-094f-4cb7-b075-4da431ca32b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:18:36.171898 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5b817cb2-094f-4cb7-b075-4da431ca32b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:18:36.185567 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-5b817cb2-094f-4cb7-b075-4da431ca32b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] HTTP exception thrown: Instance 5674ce1b-ecff-4c2f-b008-1f3c47a5c541 could not be found. Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5b817cb2-094f-4cb7-b075-4da431ca32b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Request method failure captured: Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 HTTP/1.1 Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLb_JnIZi-2nNQB5N_p7ysnehCxkUaSC8a6zhlP4-OvEpK-pSaFHLeH5SnnGH6f6uwubpon43brifNuQen6o1HMpsEaX07xFMem3XnQQhBYRKPnz6vSOZHHNiaVw8Kg82Plkjifn3pCHxeQ7GOxLPatOLmFvs3d39khpxjWOB_l1Ncts Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 01e7888a20c74078b4cb6cb8d6d44899 Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-VolumesSnapshotTestJSON-629636169 Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:18:36.187230 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:18:36.189065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/01e7888a20c74078b4cb6cb8d6d44899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/01e7888a20c74078b4cb6cb8d6d44899"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/01e7888a20c74078b4cb6cb8d6d44899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_01e7888a20c74078b4cb6cb8d6d44899"}]}] Sep 23 14:18:36.189065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-VolumesSnapshotTestJSON-629636169 Sep 23 14:18:36.189065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 01e7888a20c74078b4cb6cb8d6d44899 Sep 23 14:18:36.189065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-629636169 Sep 23 14:18:36.189065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-VolumesSnapshotTestJSON-629636169-project Sep 23 14:18:36.189065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:18:36.189065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:18:36.189065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 5da7f8c9045041a784d22edfe323716c Sep 23 14:18:36.189065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-VolumesSnapshotTestJSON-629636169-project Sep 23 14:18:36.189065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:18:36.189065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 5674ce1b-ecff-4c2f-b008-1f3c47a5c541 could not be found. Sep 23 14:18:36.189065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '5674ce1b-ecff-4c2f-b008-1f3c47a5c541'} Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5674ce1b-ecff-4c2f-b008-1f3c47a5c541 could not be found. Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:18:36.191441 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5674ce1b-ecff-4c2f-b008-1f3c47a5c541 could not be found. Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5674ce1b-ecff-4c2f-b008-1f3c47a5c541 could not be found. Sep 23 14:18:36.193086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:18:36.194591 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5b817cb2-094f-4cb7-b075-4da431ca32b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] Returning 404 to user: Instance 5674ce1b-ecff-4c2f-b008-1f3c47a5c541 could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:18:36.194591 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5b817cb2-094f-4cb7-b075-4da431ca32b9 tempest-VolumesSnapshotTestJSON-629636169 tempest-VolumesSnapshotTestJSON-629636169-project] 10.222.0.62 "GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541" status: 404 len: 111 microversion: 2.1 time: 0.031110 Sep 23 14:18:36.194591 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 537/1071] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:18:36 2022] GET /compute/v2.1/servers/5674ce1b-ecff-4c2f-b008-1f3c47a5c541 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:19:27.729392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6f18367d-1d40-407d-ba33-2e96b9c34ed4 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Action: 'create', calling method: .version_select at 0x7f9083ac79d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-239935108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIC670rwxJo36WsB6ZXUaCE0VHuQFRiWTMxvWMkNkWmp9IKITRwHPK/s8k1fRA33X3BKhgogVQLkcqQZuwyBMPbl0vrSQqfK60QuTu27ypd/vqJv9s5iQn8l47nizGTEA=="}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:19:27.735646 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=10 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:19:27.736306 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:19:27.747877 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-6f18367d-1d40-407d-ba33-2e96b9c34ed4 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Getting quotas for project 6ac60e3f01644a258f0a7ebddf8f4d30. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:19:27.752049 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.quota [None req-6f18367d-1d40-407d-ba33-2e96b9c34ed4 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Getting quotas for user 6e2be66df7b14b18b55bea07799abab3 and project 6ac60e3f01644a258f0a7ebddf8f4d30. Resources: {'key_pairs'} {{(pid=121074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:19:27.845543 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6f18367d-1d40-407d-ba33-2e96b9c34ed4 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.120018 Sep 23 14:19:27.846231 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 535/1072] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 23 14:19:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:19:27.901741 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1299615872", "imageRef": "59021f6e-e79a-4893-b525-48ab12d25173", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-239935108", "networks": [{"uuid": "47302714-65e9-4ede-a8af-ba0e8796bf37"}]}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:19:27.910908 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:19:27.911571 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:19:27.956120 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.network.neutron [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] validate_networks() for [('47302714-65e9-4ede-a8af-ba0e8796bf37', None, None, None, None, None)] {{(pid=121073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 14:19:28.340550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Flavor limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 14:19:28.340973 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Image limits 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 14:19:28.341444 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Flavor pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 14:19:28.341853 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Image pref 0:0:0 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 14:19:28.342263 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.virt.hardware [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 14:19:28.351049 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:28.351530 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:28.351965 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:28.352685 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:28.353135 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:28.353560 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:28.370627 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Getting quotas for project 6ac60e3f01644a258f0a7ebddf8f4d30. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 14:19:28.374551 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.quota [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Getting quotas for user 6e2be66df7b14b18b55bea07799abab3 and project 6ac60e3f01644a258f0a7ebddf8f4d30. Resources: {'ram', 'cores', 'instances'} {{(pid=121073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 14:19:28.385170 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Going to run 1 instances... {{(pid=121073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 14:19:28.387417 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='59021f6e-e79a-4893-b525-48ab12d25173',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 14:19:28.544162 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3c950b5a-a1cd-49ea-9783-22ce1475e5dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646457 Sep 23 14:19:28.544800 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 538/1073] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 23 14:19:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 14:19:28.556426 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6040f79c-c81a-4510-8baf-c58e388960e1 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:28.557037 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6040f79c-c81a-4510-8baf-c58e388960e1 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:28.617111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6040f79c-c81a-4510-8baf-c58e388960e1 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:28.625584 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6040f79c-c81a-4510-8baf-c58e388960e1 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1258 microversion: 2.1 time: 0.073575 Sep 23 14:19:28.626152 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 536/1074] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:28 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:29.648759 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-25822012-51ac-478e-a386-9e2ebb0163a7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:29.649365 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-25822012-51ac-478e-a386-9e2ebb0163a7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:29.704281 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-25822012-51ac-478e-a386-9e2ebb0163a7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:29.711407 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-25822012-51ac-478e-a386-9e2ebb0163a7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1258 microversion: 2.1 time: 0.066718 Sep 23 14:19:29.711981 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 539/1075] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:29 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:30.734984 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-73076315-f875-4d6a-8c48-eecb4fa6d8b2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:30.735591 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-73076315-f875-4d6a-8c48-eecb4fa6d8b2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:30.742833 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-73076315-f875-4d6a-8c48-eecb4fa6d8b2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:30.743226 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-73076315-f875-4d6a-8c48-eecb4fa6d8b2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:30.743655 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-73076315-f875-4d6a-8c48-eecb4fa6d8b2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:30.744379 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-73076315-f875-4d6a-8c48-eecb4fa6d8b2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:30.744822 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-73076315-f875-4d6a-8c48-eecb4fa6d8b2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:30.745289 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-73076315-f875-4d6a-8c48-eecb4fa6d8b2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:30.806822 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-73076315-f875-4d6a-8c48-eecb4fa6d8b2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:30.814761 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-73076315-f875-4d6a-8c48-eecb4fa6d8b2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1310 microversion: 2.1 time: 0.083968 Sep 23 14:19:30.815318 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 537/1076] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:30 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:31.840037 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-e8313bcd-227b-479e-b879-00a9a9f26a8f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:31.840680 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-e8313bcd-227b-479e-b879-00a9a9f26a8f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:31.851009 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e8313bcd-227b-479e-b879-00a9a9f26a8f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:31.851512 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e8313bcd-227b-479e-b879-00a9a9f26a8f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:31.851954 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e8313bcd-227b-479e-b879-00a9a9f26a8f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:31.852674 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e8313bcd-227b-479e-b879-00a9a9f26a8f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:31.853134 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e8313bcd-227b-479e-b879-00a9a9f26a8f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:31.853569 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-e8313bcd-227b-479e-b879-00a9a9f26a8f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:32.027781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-e8313bcd-227b-479e-b879-00a9a9f26a8f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:32.037117 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-e8313bcd-227b-479e-b879-00a9a9f26a8f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.201968 Sep 23 14:19:32.037935 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 540/1077] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:31 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:33.068503 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b8caede4-0839-47e8-a229-feb7dc66d5f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:33.069223 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b8caede4-0839-47e8-a229-feb7dc66d5f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:33.077263 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8caede4-0839-47e8-a229-feb7dc66d5f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:33.078052 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8caede4-0839-47e8-a229-feb7dc66d5f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:33.078723 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8caede4-0839-47e8-a229-feb7dc66d5f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:33.079429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8caede4-0839-47e8-a229-feb7dc66d5f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:33.079875 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8caede4-0839-47e8-a229-feb7dc66d5f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:33.080466 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b8caede4-0839-47e8-a229-feb7dc66d5f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:33.240932 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b8caede4-0839-47e8-a229-feb7dc66d5f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:33.250240 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b8caede4-0839-47e8-a229-feb7dc66d5f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.185632 Sep 23 14:19:33.251145 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 538/1078] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:33 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:34.273809 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-030ba36b-ae8e-42e5-89d3-3e00caa468f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:34.274464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-030ba36b-ae8e-42e5-89d3-3e00caa468f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:34.283101 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-030ba36b-ae8e-42e5-89d3-3e00caa468f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:34.283273 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-030ba36b-ae8e-42e5-89d3-3e00caa468f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:34.283618 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-030ba36b-ae8e-42e5-89d3-3e00caa468f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:34.284340 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-030ba36b-ae8e-42e5-89d3-3e00caa468f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:34.284799 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-030ba36b-ae8e-42e5-89d3-3e00caa468f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:34.285677 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-030ba36b-ae8e-42e5-89d3-3e00caa468f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:34.450154 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-030ba36b-ae8e-42e5-89d3-3e00caa468f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:34.459925 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-030ba36b-ae8e-42e5-89d3-3e00caa468f7 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.190413 Sep 23 14:19:34.461354 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 541/1079] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:34 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:19:35.485279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-6fc9e63a-7fe8-49a9-b7d1-dc490cbd2a25 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:35.485942 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-6fc9e63a-7fe8-49a9-b7d1-dc490cbd2a25 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:35.492685 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fc9e63a-7fe8-49a9-b7d1-dc490cbd2a25 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:35.493183 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fc9e63a-7fe8-49a9-b7d1-dc490cbd2a25 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:35.493707 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fc9e63a-7fe8-49a9-b7d1-dc490cbd2a25 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:35.494457 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fc9e63a-7fe8-49a9-b7d1-dc490cbd2a25 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:35.494918 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fc9e63a-7fe8-49a9-b7d1-dc490cbd2a25 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:35.495347 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-6fc9e63a-7fe8-49a9-b7d1-dc490cbd2a25 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:35.667544 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-6fc9e63a-7fe8-49a9-b7d1-dc490cbd2a25 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:35.676308 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-6fc9e63a-7fe8-49a9-b7d1-dc490cbd2a25 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.195178 Sep 23 14:19:35.677145 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 539/1080] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:35 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:36.700492 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-cec1c9b3-64e9-4ba2-903d-4673f4cf2b29 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:36.701133 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-cec1c9b3-64e9-4ba2-903d-4673f4cf2b29 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:36.707170 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cec1c9b3-64e9-4ba2-903d-4673f4cf2b29 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:36.707654 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cec1c9b3-64e9-4ba2-903d-4673f4cf2b29 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:36.708093 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cec1c9b3-64e9-4ba2-903d-4673f4cf2b29 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:36.708789 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cec1c9b3-64e9-4ba2-903d-4673f4cf2b29 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:36.709239 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cec1c9b3-64e9-4ba2-903d-4673f4cf2b29 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:36.709660 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cec1c9b3-64e9-4ba2-903d-4673f4cf2b29 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:36.847300 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-cec1c9b3-64e9-4ba2-903d-4673f4cf2b29 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:36.855894 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-cec1c9b3-64e9-4ba2-903d-4673f4cf2b29 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.158907 Sep 23 14:19:36.856765 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 542/1081] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:36 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:37.880581 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-c3069fcd-dec8-4e09-837f-c7efe85ee9dd tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:37.881284 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-c3069fcd-dec8-4e09-837f-c7efe85ee9dd tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:37.888556 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c3069fcd-dec8-4e09-837f-c7efe85ee9dd tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:37.889056 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c3069fcd-dec8-4e09-837f-c7efe85ee9dd tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:37.889485 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c3069fcd-dec8-4e09-837f-c7efe85ee9dd tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:37.890176 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c3069fcd-dec8-4e09-837f-c7efe85ee9dd tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:37.890655 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c3069fcd-dec8-4e09-837f-c7efe85ee9dd tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:37.891080 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-c3069fcd-dec8-4e09-837f-c7efe85ee9dd tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:38.037184 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-c3069fcd-dec8-4e09-837f-c7efe85ee9dd tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:38.046092 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-c3069fcd-dec8-4e09-837f-c7efe85ee9dd tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.169201 Sep 23 14:19:38.047084 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 540/1082] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:37 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:39.070357 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-04f4c1a9-db31-4e3d-b20c-ceb59d38acd4 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:39.071077 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-04f4c1a9-db31-4e3d-b20c-ceb59d38acd4 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:39.073507 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:19:39.078899 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-04f4c1a9-db31-4e3d-b20c-ceb59d38acd4 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:39.085495 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-04f4c1a9-db31-4e3d-b20c-ceb59d38acd4 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:39.085495 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-04f4c1a9-db31-4e3d-b20c-ceb59d38acd4 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:39.085495 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-04f4c1a9-db31-4e3d-b20c-ceb59d38acd4 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:39.085495 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-04f4c1a9-db31-4e3d-b20c-ceb59d38acd4 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:39.086255 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-04f4c1a9-db31-4e3d-b20c-ceb59d38acd4 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:39.223235 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-04f4c1a9-db31-4e3d-b20c-ceb59d38acd4 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:39.231515 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-04f4c1a9-db31-4e3d-b20c-ceb59d38acd4 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.165459 Sep 23 14:19:39.234780 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 543/1083] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:39 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:19:40.254298 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-7510d342-54b9-4ae0-84ad-53e709c1458a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:40.254950 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-7510d342-54b9-4ae0-84ad-53e709c1458a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:40.256787 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell0:SELECT=6 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:19:40.262786 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7510d342-54b9-4ae0-84ad-53e709c1458a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:40.263279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7510d342-54b9-4ae0-84ad-53e709c1458a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:40.263711 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7510d342-54b9-4ae0-84ad-53e709c1458a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:40.264400 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7510d342-54b9-4ae0-84ad-53e709c1458a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:40.264851 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7510d342-54b9-4ae0-84ad-53e709c1458a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:40.265272 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-7510d342-54b9-4ae0-84ad-53e709c1458a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:40.397822 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-7510d342-54b9-4ae0-84ad-53e709c1458a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:40.405647 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-7510d342-54b9-4ae0-84ad-53e709c1458a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.155013 Sep 23 14:19:40.411198 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 541/1084] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:40 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:40.454477 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=8 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:19:40.576140 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-d0c4ff4c-9b91-497d-9e42-da39e8e04315 req-94a312e6-12c6-4af6-8c78-64d6e8c11e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37cc15dc-ee4a-49f7-9b22-aaeacba00bbd", "tag": "8fc5fd76-db4f-4ef2-92ab-38a75f0a6856"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:19:40.585547 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-d0c4ff4c-9b91-497d-9e42-da39e8e04315 req-94a312e6-12c6-4af6-8c78-64d6e8c11e3c service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:40.586028 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-d0c4ff4c-9b91-497d-9e42-da39e8e04315 req-94a312e6-12c6-4af6-8c78-64d6e8c11e3c service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:40.586498 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-d0c4ff4c-9b91-497d-9e42-da39e8e04315 req-94a312e6-12c6-4af6-8c78-64d6e8c11e3c service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:40.597461 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-d0c4ff4c-9b91-497d-9e42-da39e8e04315 req-94a312e6-12c6-4af6-8c78-64d6e8c11e3c service nova] Creating event network-changed:8fc5fd76-db4f-4ef2-92ab-38a75f0a6856 for instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd on hv-cinder-85743 Sep 23 14:19:40.602468 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-d0c4ff4c-9b91-497d-9e42-da39e8e04315 req-94a312e6-12c6-4af6-8c78-64d6e8c11e3c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152813 Sep 23 14:19:40.603045 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 544/1085] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:19:41.428249 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a17019f4-b6eb-4950-b313-5004e08b272f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:41.428897 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a17019f4-b6eb-4950-b313-5004e08b272f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:41.435984 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a17019f4-b6eb-4950-b313-5004e08b272f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:41.436515 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a17019f4-b6eb-4950-b313-5004e08b272f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:41.436985 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a17019f4-b6eb-4950-b313-5004e08b272f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:41.437726 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a17019f4-b6eb-4950-b313-5004e08b272f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:41.438210 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a17019f4-b6eb-4950-b313-5004e08b272f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:41.438693 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a17019f4-b6eb-4950-b313-5004e08b272f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:41.572887 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a17019f4-b6eb-4950-b313-5004e08b272f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:41.582895 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a17019f4-b6eb-4950-b313-5004e08b272f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.159041 Sep 23 14:19:41.583506 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 542/1086] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:41 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:42.608600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-c3ea3a68-e341-4e58-ac03-bfee924b270b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:42.609245 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-c3ea3a68-e341-4e58-ac03-bfee924b270b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:42.615848 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c3ea3a68-e341-4e58-ac03-bfee924b270b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:42.616327 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c3ea3a68-e341-4e58-ac03-bfee924b270b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:42.616767 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c3ea3a68-e341-4e58-ac03-bfee924b270b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:42.617444 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c3ea3a68-e341-4e58-ac03-bfee924b270b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:42.617900 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c3ea3a68-e341-4e58-ac03-bfee924b270b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:42.618323 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-c3ea3a68-e341-4e58-ac03-bfee924b270b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:42.745780 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-c3ea3a68-e341-4e58-ac03-bfee924b270b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:42.753474 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-c3ea3a68-e341-4e58-ac03-bfee924b270b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.150667 Sep 23 14:19:42.754036 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 545/1087] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:42 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:43.776839 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-a79e6c88-c9e6-4ce9-90f9-3e865150c661 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:43.777508 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-a79e6c88-c9e6-4ce9-90f9-3e865150c661 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:43.784966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a79e6c88-c9e6-4ce9-90f9-3e865150c661 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:43.785457 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a79e6c88-c9e6-4ce9-90f9-3e865150c661 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:43.785898 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a79e6c88-c9e6-4ce9-90f9-3e865150c661 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:43.786624 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a79e6c88-c9e6-4ce9-90f9-3e865150c661 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:43.787109 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a79e6c88-c9e6-4ce9-90f9-3e865150c661 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:43.787541 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-a79e6c88-c9e6-4ce9-90f9-3e865150c661 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:43.926978 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-a79e6c88-c9e6-4ce9-90f9-3e865150c661 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:43.934460 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-a79e6c88-c9e6-4ce9-90f9-3e865150c661 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.161639 Sep 23 14:19:43.935030 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 543/1088] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:43 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:44.958006 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-15c679ab-c8b2-4e9a-b4d5-905597bfbcb2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:44.958721 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-15c679ab-c8b2-4e9a-b4d5-905597bfbcb2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:44.965584 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-15c679ab-c8b2-4e9a-b4d5-905597bfbcb2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:44.966072 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-15c679ab-c8b2-4e9a-b4d5-905597bfbcb2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:44.966550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-15c679ab-c8b2-4e9a-b4d5-905597bfbcb2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:44.967266 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-15c679ab-c8b2-4e9a-b4d5-905597bfbcb2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:44.967786 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-15c679ab-c8b2-4e9a-b4d5-905597bfbcb2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:44.968219 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-15c679ab-c8b2-4e9a-b4d5-905597bfbcb2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:45.097786 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-15c679ab-c8b2-4e9a-b4d5-905597bfbcb2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:45.105573 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-15c679ab-c8b2-4e9a-b4d5-905597bfbcb2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.151459 Sep 23 14:19:45.106145 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 546/1089] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:44 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:46.129453 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-f29194aa-ac01-41f4-9807-adfe537b8906 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:46.130108 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-f29194aa-ac01-41f4-9807-adfe537b8906 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:46.136270 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f29194aa-ac01-41f4-9807-adfe537b8906 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:46.138392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f29194aa-ac01-41f4-9807-adfe537b8906 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:46.138392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f29194aa-ac01-41f4-9807-adfe537b8906 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:46.138392 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f29194aa-ac01-41f4-9807-adfe537b8906 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:46.138722 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f29194aa-ac01-41f4-9807-adfe537b8906 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:46.138854 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-f29194aa-ac01-41f4-9807-adfe537b8906 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:46.226476 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-243a6c7d-3bfa-49d9-a557-fcca540d9504 req-e9aeeb3d-8e22-4142-b41c-118ce2aba002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37cc15dc-ee4a-49f7-9b22-aaeacba00bbd", "name": "network-vif-plugged", "status": "completed", "tag": "8fc5fd76-db4f-4ef2-92ab-38a75f0a6856"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:19:46.236161 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-243a6c7d-3bfa-49d9-a557-fcca540d9504 req-e9aeeb3d-8e22-4142-b41c-118ce2aba002 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:46.236640 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-243a6c7d-3bfa-49d9-a557-fcca540d9504 req-e9aeeb3d-8e22-4142-b41c-118ce2aba002 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:46.237067 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-243a6c7d-3bfa-49d9-a557-fcca540d9504 req-e9aeeb3d-8e22-4142-b41c-118ce2aba002 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:46.248301 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-243a6c7d-3bfa-49d9-a557-fcca540d9504 req-e9aeeb3d-8e22-4142-b41c-118ce2aba002 service nova] Creating event network-vif-plugged:8fc5fd76-db4f-4ef2-92ab-38a75f0a6856 for instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd on hv-cinder-85743 Sep 23 14:19:46.254390 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-243a6c7d-3bfa-49d9-a557-fcca540d9504 req-e9aeeb3d-8e22-4142-b41c-118ce2aba002 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092806 Sep 23 14:19:46.254984 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 547/1090] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:19:46.276123 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-f29194aa-ac01-41f4-9807-adfe537b8906 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:46.284025 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-f29194aa-ac01-41f4-9807-adfe537b8906 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.159320 Sep 23 14:19:46.284580 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 544/1091] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:46 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:47.307351 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-93bd0a90-929a-4853-9727-9c094552598d tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:47.308052 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-93bd0a90-929a-4853-9727-9c094552598d tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:47.314998 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93bd0a90-929a-4853-9727-9c094552598d tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:47.315484 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93bd0a90-929a-4853-9727-9c094552598d tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:47.315921 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93bd0a90-929a-4853-9727-9c094552598d tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:47.316613 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93bd0a90-929a-4853-9727-9c094552598d tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:47.317078 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93bd0a90-929a-4853-9727-9c094552598d tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:47.317506 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-93bd0a90-929a-4853-9727-9c094552598d tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:47.451841 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-93bd0a90-929a-4853-9727-9c094552598d tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:47.460028 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-93bd0a90-929a-4853-9727-9c094552598d tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.156854 Sep 23 14:19:47.460817 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 548/1092] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:47 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:48.484836 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-b207b555-ca5d-489c-8835-00aaa6dd10e5 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:48.485393 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-b207b555-ca5d-489c-8835-00aaa6dd10e5 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:48.492064 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b207b555-ca5d-489c-8835-00aaa6dd10e5 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:48.492548 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b207b555-ca5d-489c-8835-00aaa6dd10e5 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:48.492986 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b207b555-ca5d-489c-8835-00aaa6dd10e5 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:48.493673 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b207b555-ca5d-489c-8835-00aaa6dd10e5 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:48.494130 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b207b555-ca5d-489c-8835-00aaa6dd10e5 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:48.494585 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-b207b555-ca5d-489c-8835-00aaa6dd10e5 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:48.626103 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-b207b555-ca5d-489c-8835-00aaa6dd10e5 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:48.634064 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-b207b555-ca5d-489c-8835-00aaa6dd10e5 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1358 microversion: 2.1 time: 0.153968 Sep 23 14:19:48.634706 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 545/1093] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:48 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:49.657832 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d91c65e6-3851-407d-8b1b-86faa6f465dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:49.658422 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d91c65e6-3851-407d-8b1b-86faa6f465dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:49.665141 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d91c65e6-3851-407d-8b1b-86faa6f465dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:49.665628 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d91c65e6-3851-407d-8b1b-86faa6f465dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:49.666066 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d91c65e6-3851-407d-8b1b-86faa6f465dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:49.666796 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d91c65e6-3851-407d-8b1b-86faa6f465dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:49.667248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d91c65e6-3851-407d-8b1b-86faa6f465dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:49.667672 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d91c65e6-3851-407d-8b1b-86faa6f465dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:49.801355 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d91c65e6-3851-407d-8b1b-86faa6f465dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:49.810856 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d91c65e6-3851-407d-8b1b-86faa6f465dc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1547 microversion: 2.1 time: 0.157326 Sep 23 14:19:49.811436 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 549/1094] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:49 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:49.833830 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-8e725b8f-54fb-4f35-9977-01faf3c97353 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:49.834473 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-8e725b8f-54fb-4f35-9977-01faf3c97353 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:49.841916 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e725b8f-54fb-4f35-9977-01faf3c97353 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:49.842561 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e725b8f-54fb-4f35-9977-01faf3c97353 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:49.843676 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e725b8f-54fb-4f35-9977-01faf3c97353 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:49.844384 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e725b8f-54fb-4f35-9977-01faf3c97353 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:49.844843 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e725b8f-54fb-4f35-9977-01faf3c97353 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:49.845296 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-8e725b8f-54fb-4f35-9977-01faf3c97353 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:49.973842 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-8e725b8f-54fb-4f35-9977-01faf3c97353 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:49.981992 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-8e725b8f-54fb-4f35-9977-01faf3c97353 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1547 microversion: 2.1 time: 0.152255 Sep 23 14:19:49.982629 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 546/1095] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:49 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:50.004487 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-3c23e4b4-104b-49ac-b402-a446fd58f39e tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:50.009319 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-3c23e4b4-104b-49ac-b402-a446fd58f39e tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:50.010086 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-3c23e4b4-104b-49ac-b402-a446fd58f39e tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Searching by: {'deleted': False, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30'} {{(pid=121073) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 14:19:50.017071 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c23e4b4-104b-49ac-b402-a446fd58f39e tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:50.017553 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c23e4b4-104b-49ac-b402-a446fd58f39e tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:50.017986 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c23e4b4-104b-49ac-b402-a446fd58f39e tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:50.018812 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c23e4b4-104b-49ac-b402-a446fd58f39e tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:50.019278 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c23e4b4-104b-49ac-b402-a446fd58f39e tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:50.019698 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-3c23e4b4-104b-49ac-b402-a446fd58f39e tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:50.109450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.multi_cell_list [None req-3c23e4b4-104b-49ac-b402-a446fd58f39e tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121073) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 14:19:50.222360 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-3c23e4b4-104b-49ac-b402-a446fd58f39e tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.221582 Sep 23 14:19:50.265383 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 550/1096] 10.222.0.62 () {58 vars in 1125 bytes} [Fri Sep 23 14:19:49 2022] GET /compute/v2.1/servers => generated 343 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:19:50.266292 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-43be2eb2-5665-4771-aee4-5493d6c27052 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:19:50.266292 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-43be2eb2-5665-4771-aee4-5493d6c27052 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:50.266292 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43be2eb2-5665-4771-aee4-5493d6c27052 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:50.266292 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43be2eb2-5665-4771-aee4-5493d6c27052 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:50.266734 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43be2eb2-5665-4771-aee4-5493d6c27052 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:50.266734 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43be2eb2-5665-4771-aee4-5493d6c27052 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:50.266734 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43be2eb2-5665-4771-aee4-5493d6c27052 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:50.266734 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-43be2eb2-5665-4771-aee4-5493d6c27052 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:50.379471 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-43be2eb2-5665-4771-aee4-5493d6c27052 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:19:50.387118 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-43be2eb2-5665-4771-aee4-5493d6c27052 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1547 microversion: 2.1 time: 0.156508 Sep 23 14:19:50.387679 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 547/1097] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:19:50 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:19:52.372703 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-6b010a82-cd1b-4671-be6c-c307f9d8312f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08b53cff-e79e-4281-b41a-4394cf237973"}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:19:52.375578 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-6b010a82-cd1b-4671-be6c-c307f9d8312f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:19:52.382104 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6b010a82-cd1b-4671-be6c-c307f9d8312f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:52.382659 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6b010a82-cd1b-4671-be6c-c307f9d8312f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:52.383179 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6b010a82-cd1b-4671-be6c-c307f9d8312f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:52.383869 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6b010a82-cd1b-4671-be6c-c307f9d8312f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:19:52.384324 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6b010a82-cd1b-4671-be6c-c307f9d8312f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:19:52.384746 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-6b010a82-cd1b-4671-be6c-c307f9d8312f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:19:53.177899 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-6b010a82-cd1b-4671-be6c-c307f9d8312f tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "POST /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.809052 Sep 23 14:19:53.178597 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 551/1098] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 23 14:19:52 2022] POST /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/os-volume_attachments => generated 194 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:20:01.836206 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-1846dd1b-a03b-4d56-a3ae-6a663e1de8a2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:01.836819 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-1846dd1b-a03b-4d56-a3ae-6a663e1de8a2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:01.839360 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:20:01.840012 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=66 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:20:01.844597 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1846dd1b-a03b-4d56-a3ae-6a663e1de8a2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:01.845117 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1846dd1b-a03b-4d56-a3ae-6a663e1de8a2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:01.845555 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1846dd1b-a03b-4d56-a3ae-6a663e1de8a2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:01.846244 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1846dd1b-a03b-4d56-a3ae-6a663e1de8a2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:01.846731 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1846dd1b-a03b-4d56-a3ae-6a663e1de8a2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:01.847191 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-1846dd1b-a03b-4d56-a3ae-6a663e1de8a2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:01.973834 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-1846dd1b-a03b-4d56-a3ae-6a663e1de8a2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:01.982100 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-1846dd1b-a03b-4d56-a3ae-6a663e1de8a2 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1593 microversion: 2.1 time: 0.149715 Sep 23 14:20:01.982731 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 548/1099] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:01 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1593 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:03.973233 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell0:SELECT=2 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:20:03.974098 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:20:03.975053 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:20:04.035677 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-2d663e06-89f5-431e-8a45-60d6d8768cce req-7139689d-5470-4144-ba65-e337d2d589f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37cc15dc-ee4a-49f7-9b22-aaeacba00bbd", "tag": "8fc5fd76-db4f-4ef2-92ab-38a75f0a6856"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:20:04.045439 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2d663e06-89f5-431e-8a45-60d6d8768cce req-7139689d-5470-4144-ba65-e337d2d589f5 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:04.045921 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2d663e06-89f5-431e-8a45-60d6d8768cce req-7139689d-5470-4144-ba65-e337d2d589f5 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:04.046363 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-2d663e06-89f5-431e-8a45-60d6d8768cce req-7139689d-5470-4144-ba65-e337d2d589f5 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:04.057924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-2d663e06-89f5-431e-8a45-60d6d8768cce req-7139689d-5470-4144-ba65-e337d2d589f5 service nova] Creating event network-changed:8fc5fd76-db4f-4ef2-92ab-38a75f0a6856 for instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd on hv-cinder-85743 Sep 23 14:20:04.063148 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-2d663e06-89f5-431e-8a45-60d6d8768cce req-7139689d-5470-4144-ba65-e337d2d589f5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091181 Sep 23 14:20:04.064364 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 552/1100] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:20:06.892538 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e3c3c036-8533-496e-8b82-af4a3024fbd3 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-257700856"}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:20:06.893110 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e3c3c036-8533-496e-8b82-af4a3024fbd3 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:06.899482 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e3c3c036-8533-496e-8b82-af4a3024fbd3 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:06.900002 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e3c3c036-8533-496e-8b82-af4a3024fbd3 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:06.900439 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e3c3c036-8533-496e-8b82-af4a3024fbd3 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:06.901130 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e3c3c036-8533-496e-8b82-af4a3024fbd3 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:06.901584 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e3c3c036-8533-496e-8b82-af4a3024fbd3 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:06.902013 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e3c3c036-8533-496e-8b82-af4a3024fbd3 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:07.029717 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.network.security_group_api [None req-e3c3c036-8533-496e-8b82-af4a3024fbd3 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Adding security group e04e258c-b803-47a9-bd50-38f535c46d29 to port 8fc5fd76-db4f-4ef2-92ab-38a75f0a6856 Sep 23 14:20:07.672918 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e3c3c036-8533-496e-8b82-af4a3024fbd3 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "POST /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/action" status: 202 len: 0 microversion: 2.1 time: 0.784455 Sep 23 14:20:07.673613 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 549/1101] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 23 14:20:06 2022] POST /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/action => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:20:07.683673 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-af94e5de-e02b-46bf-9130-9f77a6d580b0 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:07.684245 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-b0ccede9-9955-4ab0-b942-deb3f802f5ba req-1cbeaf6d-a4dd-42dd-946b-920c272d3b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37cc15dc-ee4a-49f7-9b22-aaeacba00bbd", "tag": "8fc5fd76-db4f-4ef2-92ab-38a75f0a6856"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:20:07.684374 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-af94e5de-e02b-46bf-9130-9f77a6d580b0 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:07.692550 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-af94e5de-e02b-46bf-9130-9f77a6d580b0 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:07.693390 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-af94e5de-e02b-46bf-9130-9f77a6d580b0 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:07.694069 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-af94e5de-e02b-46bf-9130-9f77a6d580b0 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:07.694283 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-b0ccede9-9955-4ab0-b942-deb3f802f5ba req-1cbeaf6d-a4dd-42dd-946b-920c272d3b4e service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:07.695105 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-b0ccede9-9955-4ab0-b942-deb3f802f5ba req-1cbeaf6d-a4dd-42dd-946b-920c272d3b4e service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:07.695450 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-af94e5de-e02b-46bf-9130-9f77a6d580b0 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:07.695601 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-b0ccede9-9955-4ab0-b942-deb3f802f5ba req-1cbeaf6d-a4dd-42dd-946b-920c272d3b4e service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:07.696367 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-af94e5de-e02b-46bf-9130-9f77a6d580b0 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:07.696789 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-af94e5de-e02b-46bf-9130-9f77a6d580b0 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:07.858190 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-b0ccede9-9955-4ab0-b942-deb3f802f5ba req-1cbeaf6d-a4dd-42dd-946b-920c272d3b4e service nova] Creating event network-changed:8fc5fd76-db4f-4ef2-92ab-38a75f0a6856 for instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd on hv-cinder-85743 Sep 23 14:20:07.863483 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-b0ccede9-9955-4ab0-b942-deb3f802f5ba req-1cbeaf6d-a4dd-42dd-946b-920c272d3b4e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183372 Sep 23 14:20:07.864253 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 550/1102] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 14:20:07.868389 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-af94e5de-e02b-46bf-9130-9f77a6d580b0 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:07.877962 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-af94e5de-e02b-46bf-9130-9f77a6d580b0 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1758 microversion: 2.1 time: 0.199510 Sep 23 14:20:07.878578 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 553/1103] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:07 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:28.610713 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 14:20:28.611279 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Fri Sep 23 14:20:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/action (ip 10.222.0.62) !!! Sep 23 14:20:28.611886 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=6 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:20:28.612629 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=12 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:20:28.617569 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-9b4f9ac7-18a8-4df1-ae0e-ae206c9ba2bc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:20:28.619856 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-9b4f9ac7-18a8-4df1-ae0e-ae206c9ba2bc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:28.626840 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9b4f9ac7-18a8-4df1-ae0e-ae206c9ba2bc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:28.627330 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9b4f9ac7-18a8-4df1-ae0e-ae206c9ba2bc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:28.627773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9b4f9ac7-18a8-4df1-ae0e-ae206c9ba2bc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:28.628465 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9b4f9ac7-18a8-4df1-ae0e-ae206c9ba2bc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:28.628926 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9b4f9ac7-18a8-4df1-ae0e-ae206c9ba2bc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:28.629366 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-9b4f9ac7-18a8-4df1-ae0e-ae206c9ba2bc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:28.855491 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-9b4f9ac7-18a8-4df1-ae0e-ae206c9ba2bc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "POST /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/action" status: 202 len: 0 microversion: 2.1 time: 0.246451 Sep 23 14:20:28.856122 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 551/1104] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 23 14:20:28 2022] POST /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:20:28.865616 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-0f9f3fb1-701e-42d5-b400-a466612f8e4a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:28.865616 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-0f9f3fb1-701e-42d5-b400-a466612f8e4a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:28.868287 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 14:20:28.868466 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Fri Sep 23 14:20:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd (ip 10.222.0.62) !!! Sep 23 14:20:28.870248 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=4 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:20:28.870462 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=8 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:20:28.876082 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0f9f3fb1-701e-42d5-b400-a466612f8e4a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:28.876569 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0f9f3fb1-701e-42d5-b400-a466612f8e4a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:28.877005 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0f9f3fb1-701e-42d5-b400-a466612f8e4a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:28.877704 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0f9f3fb1-701e-42d5-b400-a466612f8e4a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:28.878168 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0f9f3fb1-701e-42d5-b400-a466612f8e4a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:28.878628 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0f9f3fb1-701e-42d5-b400-a466612f8e4a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:29.023359 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-0f9f3fb1-701e-42d5-b400-a466612f8e4a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:29.032016 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-0f9f3fb1-701e-42d5-b400-a466612f8e4a tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1750 microversion: 2.1 time: 0.171562 Sep 23 14:20:29.032682 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 554/1105] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:28 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:30.059283 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ee2bc9bd-9e81-42a2-9fd8-20621af9e759 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:30.059998 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ee2bc9bd-9e81-42a2-9fd8-20621af9e759 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:30.066962 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee2bc9bd-9e81-42a2-9fd8-20621af9e759 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:30.067472 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee2bc9bd-9e81-42a2-9fd8-20621af9e759 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:30.067939 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee2bc9bd-9e81-42a2-9fd8-20621af9e759 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:30.068643 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee2bc9bd-9e81-42a2-9fd8-20621af9e759 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:30.069104 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee2bc9bd-9e81-42a2-9fd8-20621af9e759 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:30.069536 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ee2bc9bd-9e81-42a2-9fd8-20621af9e759 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:30.221151 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ee2bc9bd-9e81-42a2-9fd8-20621af9e759 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:30.232796 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ee2bc9bd-9e81-42a2-9fd8-20621af9e759 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1755 microversion: 2.1 time: 0.177005 Sep 23 14:20:30.232796 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 552/1106] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:30 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:31.255454 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1515d40f-00b3-4605-88b7-3e1d05c25a06 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:31.256057 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1515d40f-00b3-4605-88b7-3e1d05c25a06 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:31.263166 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1515d40f-00b3-4605-88b7-3e1d05c25a06 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:31.263653 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1515d40f-00b3-4605-88b7-3e1d05c25a06 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:31.264092 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1515d40f-00b3-4605-88b7-3e1d05c25a06 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:31.264787 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1515d40f-00b3-4605-88b7-3e1d05c25a06 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:31.265240 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1515d40f-00b3-4605-88b7-3e1d05c25a06 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:31.265664 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1515d40f-00b3-4605-88b7-3e1d05c25a06 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:31.408257 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1515d40f-00b3-4605-88b7-3e1d05c25a06 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:31.416666 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1515d40f-00b3-4605-88b7-3e1d05c25a06 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1755 microversion: 2.1 time: 0.165636 Sep 23 14:20:31.417245 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 555/1107] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:31 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:32.439824 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-832a132e-5e89-4419-861b-adf664163764 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:32.440467 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-832a132e-5e89-4419-861b-adf664163764 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:32.447436 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-832a132e-5e89-4419-861b-adf664163764 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:32.447919 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-832a132e-5e89-4419-861b-adf664163764 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:32.448417 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-832a132e-5e89-4419-861b-adf664163764 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:32.449099 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-832a132e-5e89-4419-861b-adf664163764 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:32.449545 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-832a132e-5e89-4419-861b-adf664163764 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:32.449962 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-832a132e-5e89-4419-861b-adf664163764 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:32.593501 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-832a132e-5e89-4419-861b-adf664163764 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:32.601773 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-832a132e-5e89-4419-861b-adf664163764 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1755 microversion: 2.1 time: 0.165759 Sep 23 14:20:32.602578 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 553/1108] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:32 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:33.625415 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-ae08e4c2-c5af-4704-b314-2cbda4910b83 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:33.625998 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-ae08e4c2-c5af-4704-b314-2cbda4910b83 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:33.632329 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ae08e4c2-c5af-4704-b314-2cbda4910b83 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:33.632813 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ae08e4c2-c5af-4704-b314-2cbda4910b83 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:33.633299 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ae08e4c2-c5af-4704-b314-2cbda4910b83 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:33.634110 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ae08e4c2-c5af-4704-b314-2cbda4910b83 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:33.634594 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ae08e4c2-c5af-4704-b314-2cbda4910b83 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:33.635063 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-ae08e4c2-c5af-4704-b314-2cbda4910b83 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:33.775221 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-ae08e4c2-c5af-4704-b314-2cbda4910b83 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:33.783938 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-ae08e4c2-c5af-4704-b314-2cbda4910b83 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1755 microversion: 2.1 time: 0.162393 Sep 23 14:20:33.784534 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 556/1109] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:33 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:34.807215 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-5532b5c0-9212-4cc1-bdc9-6db5aaf26046 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:34.807826 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-5532b5c0-9212-4cc1-bdc9-6db5aaf26046 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:34.814138 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5532b5c0-9212-4cc1-bdc9-6db5aaf26046 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:34.814659 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5532b5c0-9212-4cc1-bdc9-6db5aaf26046 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:34.815102 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5532b5c0-9212-4cc1-bdc9-6db5aaf26046 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:34.815790 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5532b5c0-9212-4cc1-bdc9-6db5aaf26046 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:34.816249 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5532b5c0-9212-4cc1-bdc9-6db5aaf26046 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:34.816670 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-5532b5c0-9212-4cc1-bdc9-6db5aaf26046 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:34.955766 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-5532b5c0-9212-4cc1-bdc9-6db5aaf26046 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:34.964498 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-5532b5c0-9212-4cc1-bdc9-6db5aaf26046 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1755 microversion: 2.1 time: 0.161794 Sep 23 14:20:34.965057 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 554/1110] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:34 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:35.988303 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a6a7e6ba-0e5e-4043-865c-5f51b9994328 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:35.988920 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a6a7e6ba-0e5e-4043-865c-5f51b9994328 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:35.994821 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6a7e6ba-0e5e-4043-865c-5f51b9994328 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:35.995308 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6a7e6ba-0e5e-4043-865c-5f51b9994328 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:35.995743 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6a7e6ba-0e5e-4043-865c-5f51b9994328 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:35.996430 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6a7e6ba-0e5e-4043-865c-5f51b9994328 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:35.996885 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6a7e6ba-0e5e-4043-865c-5f51b9994328 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:35.997312 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a6a7e6ba-0e5e-4043-865c-5f51b9994328 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:36.141267 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-a6a7e6ba-0e5e-4043-865c-5f51b9994328 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:36.150342 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a6a7e6ba-0e5e-4043-865c-5f51b9994328 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1755 microversion: 2.1 time: 0.165972 Sep 23 14:20:36.150930 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 557/1111] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:35 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:37.173708 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4632ed0b-1e0a-475d-8bf4-8aa77477d504 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:37.174308 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4632ed0b-1e0a-475d-8bf4-8aa77477d504 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:37.180825 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4632ed0b-1e0a-475d-8bf4-8aa77477d504 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:37.181299 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4632ed0b-1e0a-475d-8bf4-8aa77477d504 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:37.181731 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4632ed0b-1e0a-475d-8bf4-8aa77477d504 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:37.182440 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4632ed0b-1e0a-475d-8bf4-8aa77477d504 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:37.182892 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4632ed0b-1e0a-475d-8bf4-8aa77477d504 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:37.183312 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4632ed0b-1e0a-475d-8bf4-8aa77477d504 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:37.327593 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4632ed0b-1e0a-475d-8bf4-8aa77477d504 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:37.335856 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4632ed0b-1e0a-475d-8bf4-8aa77477d504 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1755 microversion: 2.1 time: 0.166017 Sep 23 14:20:37.336921 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 555/1112] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:37 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:38.359917 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-d52d9ec6-b8ed-4f31-b168-2221c2b8d40c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:38.360548 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-d52d9ec6-b8ed-4f31-b168-2221c2b8d40c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:38.366974 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d52d9ec6-b8ed-4f31-b168-2221c2b8d40c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:38.368065 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d52d9ec6-b8ed-4f31-b168-2221c2b8d40c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:38.368498 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d52d9ec6-b8ed-4f31-b168-2221c2b8d40c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:38.369178 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d52d9ec6-b8ed-4f31-b168-2221c2b8d40c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:38.369626 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d52d9ec6-b8ed-4f31-b168-2221c2b8d40c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:38.370044 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-d52d9ec6-b8ed-4f31-b168-2221c2b8d40c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:38.512806 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-d52d9ec6-b8ed-4f31-b168-2221c2b8d40c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:38.521006 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-d52d9ec6-b8ed-4f31-b168-2221c2b8d40c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1755 microversion: 2.1 time: 0.165002 Sep 23 14:20:38.521566 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 558/1113] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:38 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:39.544999 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-4f4a44de-7cb7-4e71-b0d2-ae152232cfd1 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:39.545562 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-4f4a44de-7cb7-4e71-b0d2-ae152232cfd1 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:39.552381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4f4a44de-7cb7-4e71-b0d2-ae152232cfd1 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:39.552862 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4f4a44de-7cb7-4e71-b0d2-ae152232cfd1 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:39.553297 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4f4a44de-7cb7-4e71-b0d2-ae152232cfd1 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:39.553979 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4f4a44de-7cb7-4e71-b0d2-ae152232cfd1 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:39.554455 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4f4a44de-7cb7-4e71-b0d2-ae152232cfd1 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:39.554889 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-4f4a44de-7cb7-4e71-b0d2-ae152232cfd1 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:39.700380 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-4f4a44de-7cb7-4e71-b0d2-ae152232cfd1 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:39.708902 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-4f4a44de-7cb7-4e71-b0d2-ae152232cfd1 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1755 microversion: 2.1 time: 0.167783 Sep 23 14:20:39.709483 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 556/1114] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:39 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:40.739945 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-2223ab66-73d5-4006-a2c5-eb257454d8a6 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:40.739945 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-2223ab66-73d5-4006-a2c5-eb257454d8a6 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:40.740600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2223ab66-73d5-4006-a2c5-eb257454d8a6 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:40.741067 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2223ab66-73d5-4006-a2c5-eb257454d8a6 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:40.741499 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2223ab66-73d5-4006-a2c5-eb257454d8a6 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:40.742185 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2223ab66-73d5-4006-a2c5-eb257454d8a6 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:40.743396 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2223ab66-73d5-4006-a2c5-eb257454d8a6 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:40.743924 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-2223ab66-73d5-4006-a2c5-eb257454d8a6 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:40.882519 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-2223ab66-73d5-4006-a2c5-eb257454d8a6 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:40.898987 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-2223ab66-73d5-4006-a2c5-eb257454d8a6 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1755 microversion: 2.1 time: 0.170228 Sep 23 14:20:40.899562 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 559/1115] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:40 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 14:20:41.923361 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d1b6704e-d222-4214-af50-45e47f4e6719 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:41.923966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-d1b6704e-d222-4214-af50-45e47f4e6719 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:41.930381 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d1b6704e-d222-4214-af50-45e47f4e6719 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:41.933326 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d1b6704e-d222-4214-af50-45e47f4e6719 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:41.933326 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d1b6704e-d222-4214-af50-45e47f4e6719 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:41.933326 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d1b6704e-d222-4214-af50-45e47f4e6719 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:41.933640 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d1b6704e-d222-4214-af50-45e47f4e6719 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:41.934025 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-d1b6704e-d222-4214-af50-45e47f4e6719 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:42.085620 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-d1b6704e-d222-4214-af50-45e47f4e6719 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:42.094262 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d1b6704e-d222-4214-af50-45e47f4e6719 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1755 microversion: 2.1 time: 0.174713 Sep 23 14:20:42.094861 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 557/1116] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:41 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:43.117193 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-1a06d6dc-1ae0-4a49-847a-7a4a5b27b161 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:43.117809 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-1a06d6dc-1ae0-4a49-847a-7a4a5b27b161 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:43.124966 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a06d6dc-1ae0-4a49-847a-7a4a5b27b161 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:43.125457 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a06d6dc-1ae0-4a49-847a-7a4a5b27b161 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:43.125936 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a06d6dc-1ae0-4a49-847a-7a4a5b27b161 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:43.126670 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a06d6dc-1ae0-4a49-847a-7a4a5b27b161 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:43.127207 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a06d6dc-1ae0-4a49-847a-7a4a5b27b161 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:43.127658 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-1a06d6dc-1ae0-4a49-847a-7a4a5b27b161 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:43.271087 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-1a06d6dc-1ae0-4a49-847a-7a4a5b27b161 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:43.279566 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-1a06d6dc-1ae0-4a49-847a-7a4a5b27b161 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1755 microversion: 2.1 time: 0.166361 Sep 23 14:20:43.280135 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 560/1117] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:43 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:44.303307 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-ddf51079-0fa5-4fdf-b8cd-5dac3a81d72c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:44.303916 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-ddf51079-0fa5-4fdf-b8cd-5dac3a81d72c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:44.310690 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ddf51079-0fa5-4fdf-b8cd-5dac3a81d72c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:44.311202 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ddf51079-0fa5-4fdf-b8cd-5dac3a81d72c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:44.311637 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ddf51079-0fa5-4fdf-b8cd-5dac3a81d72c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:44.312330 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ddf51079-0fa5-4fdf-b8cd-5dac3a81d72c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:44.312779 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ddf51079-0fa5-4fdf-b8cd-5dac3a81d72c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:44.313202 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-ddf51079-0fa5-4fdf-b8cd-5dac3a81d72c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:44.459302 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-ddf51079-0fa5-4fdf-b8cd-5dac3a81d72c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:44.468104 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-ddf51079-0fa5-4fdf-b8cd-5dac3a81d72c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1755 microversion: 2.1 time: 0.168700 Sep 23 14:20:44.468674 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 558/1118] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:44 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:45.490886 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-0bca4720-5f78-43ae-87a3-1f33472ea55b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:45.491497 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-0bca4720-5f78-43ae-87a3-1f33472ea55b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:45.498480 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0bca4720-5f78-43ae-87a3-1f33472ea55b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:45.498963 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0bca4720-5f78-43ae-87a3-1f33472ea55b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:45.499398 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0bca4720-5f78-43ae-87a3-1f33472ea55b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:45.500078 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0bca4720-5f78-43ae-87a3-1f33472ea55b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:45.500530 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0bca4720-5f78-43ae-87a3-1f33472ea55b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:45.500952 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-0bca4720-5f78-43ae-87a3-1f33472ea55b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:45.641403 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-0bca4720-5f78-43ae-87a3-1f33472ea55b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:45.649610 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-0bca4720-5f78-43ae-87a3-1f33472ea55b tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1755 microversion: 2.1 time: 0.162622 Sep 23 14:20:45.650293 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 561/1119] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:45 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:20:46.673187 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-75f688bf-33ce-4f90-8fe1-2e65f7c4ddab tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:20:46.673792 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-75f688bf-33ce-4f90-8fe1-2e65f7c4ddab tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:20:46.679785 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-75f688bf-33ce-4f90-8fe1-2e65f7c4ddab tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:46.680264 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-75f688bf-33ce-4f90-8fe1-2e65f7c4ddab tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:46.680694 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-75f688bf-33ce-4f90-8fe1-2e65f7c4ddab tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:46.681990 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-75f688bf-33ce-4f90-8fe1-2e65f7c4ddab tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:20:46.682482 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-75f688bf-33ce-4f90-8fe1-2e65f7c4ddab tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:20:46.682905 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-75f688bf-33ce-4f90-8fe1-2e65f7c4ddab tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:20:46.829645 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-75f688bf-33ce-4f90-8fe1-2e65f7c4ddab tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:20:46.837962 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-75f688bf-33ce-4f90-8fe1-2e65f7c4ddab tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1758 microversion: 2.1 time: 0.168894 Sep 23 14:20:46.838580 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 559/1120] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:20:46 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:21:19.923578 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-39a74858-f054-406e-b1ea-cafb4cf096f9 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-257700856"}} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:21:19.924239 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-39a74858-f054-406e-b1ea-cafb4cf096f9 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:21:19.926392 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_api:SELECT=16 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:21:19.927178 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG dbcounter [-] [121073] Writing DB stats nova_cell1:SELECT=48 {{(pid=121073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:21:19.932974 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39a74858-f054-406e-b1ea-cafb4cf096f9 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:19.933920 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39a74858-f054-406e-b1ea-cafb4cf096f9 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:19.934692 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39a74858-f054-406e-b1ea-cafb4cf096f9 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:19.935939 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39a74858-f054-406e-b1ea-cafb4cf096f9 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:19.936718 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39a74858-f054-406e-b1ea-cafb4cf096f9 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:19.937431 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-39a74858-f054-406e-b1ea-cafb4cf096f9 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:20.082409 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.network.security_group_api [None req-39a74858-f054-406e-b1ea-cafb4cf096f9 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Removing security group e04e258c-b803-47a9-bd50-38f535c46d29 from port 8fc5fd76-db4f-4ef2-92ab-38a75f0a6856 Sep 23 14:21:20.533320 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-39a74858-f054-406e-b1ea-cafb4cf096f9 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "POST /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/action" status: 202 len: 0 microversion: 2.1 time: 0.610331 Sep 23 14:21:20.533320 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 562/1121] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 23 14:21:19 2022] POST /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 14:21:20.539845 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [req-3ac87c2c-9592-4d60-a144-fb76b2d9cd33 req-7c643cad-6202-4576-97d8-0e989a3f78de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37cc15dc-ee4a-49f7-9b22-aaeacba00bbd", "tag": "8fc5fd76-db4f-4ef2-92ab-38a75f0a6856"}]} {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:21:20.546844 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_api:SELECT=18 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:21:20.547553 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG dbcounter [-] [121074] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:21:20.553169 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-3ac87c2c-9592-4d60-a144-fb76b2d9cd33 req-7c643cad-6202-4576-97d8-0e989a3f78de service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:20.553693 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-3ac87c2c-9592-4d60-a144-fb76b2d9cd33 req-7c643cad-6202-4576-97d8-0e989a3f78de service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:20.554172 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [req-3ac87c2c-9592-4d60-a144-fb76b2d9cd33 req-7c643cad-6202-4576-97d8-0e989a3f78de service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:20.567725 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.compute.server_external_events [req-3ac87c2c-9592-4d60-a144-fb76b2d9cd33 req-7c643cad-6202-4576-97d8-0e989a3f78de service nova] Creating event network-changed:8fc5fd76-db4f-4ef2-92ab-38a75f0a6856 for instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd on hv-cinder-85743 Sep 23 14:21:20.573242 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [req-3ac87c2c-9592-4d60-a144-fb76b2d9cd33 req-7c643cad-6202-4576-97d8-0e989a3f78de service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037318 Sep 23 14:21:20.575115 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 560/1122] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:21:22.108869 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-cdc252ed-0759-49d7-8533-db5423244327 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:21:22.111784 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-cdc252ed-0759-49d7-8533-db5423244327 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:21:22.115521 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cdc252ed-0759-49d7-8533-db5423244327 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:22.116174 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cdc252ed-0759-49d7-8533-db5423244327 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:22.116955 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cdc252ed-0759-49d7-8533-db5423244327 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:22.117673 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cdc252ed-0759-49d7-8533-db5423244327 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:22.118138 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cdc252ed-0759-49d7-8533-db5423244327 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:22.118600 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-cdc252ed-0759-49d7-8533-db5423244327 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:22.206496 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.objects.instance [None req-cdc252ed-0759-49d7-8533-db5423244327 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lazy-loading 'services' on Instance uuid 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd {{(pid=121073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:21:22.408372 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-cdc252ed-0759-49d7-8533-db5423244327 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "DELETE /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/os-volume_attachments/08b53cff-e79e-4281-b41a-4394cf237973" status: 202 len: 0 microversion: 2.1 time: 0.306813 Sep 23 14:21:22.408972 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 563/1123] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 23 14:21:22 2022] DELETE /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/os-volume_attachments/08b53cff-e79e-4281-b41a-4394cf237973 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 14:21:22.419211 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-262711f1-a853-4250-be33-bf08549d9986 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:21:22.421477 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-262711f1-a853-4250-be33-bf08549d9986 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:21:22.431137 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-262711f1-a853-4250-be33-bf08549d9986 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:22.431137 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-262711f1-a853-4250-be33-bf08549d9986 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:22.431137 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-262711f1-a853-4250-be33-bf08549d9986 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:22.431137 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-262711f1-a853-4250-be33-bf08549d9986 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:22.431502 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-262711f1-a853-4250-be33-bf08549d9986 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:22.431848 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-262711f1-a853-4250-be33-bf08549d9986 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:22.472589 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-262711f1-a853-4250-be33-bf08549d9986 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058812 Sep 23 14:21:22.473304 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 561/1124] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:21:22 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:21:22.596486 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-01a73fdb-b932-45c9-9555-ba914f313341 req-267af069-d9a6-44e2-ae83-9a7bfb46e1ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37cc15dc-ee4a-49f7-9b22-aaeacba00bbd", "tag": "8fc5fd76-db4f-4ef2-92ab-38a75f0a6856"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:21:22.610908 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-01a73fdb-b932-45c9-9555-ba914f313341 req-267af069-d9a6-44e2-ae83-9a7bfb46e1ac service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:22.611496 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-01a73fdb-b932-45c9-9555-ba914f313341 req-267af069-d9a6-44e2-ae83-9a7bfb46e1ac service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:22.612141 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-01a73fdb-b932-45c9-9555-ba914f313341 req-267af069-d9a6-44e2-ae83-9a7bfb46e1ac service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:22.625125 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-01a73fdb-b932-45c9-9555-ba914f313341 req-267af069-d9a6-44e2-ae83-9a7bfb46e1ac service nova] Creating event network-changed:8fc5fd76-db4f-4ef2-92ab-38a75f0a6856 for instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd on hv-cinder-85743 Sep 23 14:21:22.630132 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-01a73fdb-b932-45c9-9555-ba914f313341 req-267af069-d9a6-44e2-ae83-9a7bfb46e1ac service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040617 Sep 23 14:21:22.631171 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 564/1125] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:21:23.489478 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-e1278760-4d56-44b0-b975-449d1f8bfffc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:21:23.491979 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-e1278760-4d56-44b0-b975-449d1f8bfffc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:21:23.500477 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e1278760-4d56-44b0-b975-449d1f8bfffc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:23.500966 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e1278760-4d56-44b0-b975-449d1f8bfffc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:23.501411 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e1278760-4d56-44b0-b975-449d1f8bfffc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:23.502124 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e1278760-4d56-44b0-b975-449d1f8bfffc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:23.502621 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e1278760-4d56-44b0-b975-449d1f8bfffc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:23.503054 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-e1278760-4d56-44b0-b975-449d1f8bfffc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:23.536616 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-e1278760-4d56-44b0-b975-449d1f8bfffc tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051755 Sep 23 14:21:23.537398 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 562/1126] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:21:23 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:21:24.551207 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-890ea37d-9b9e-4387-86dc-079e90fbdc35 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:21:24.553357 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-890ea37d-9b9e-4387-86dc-079e90fbdc35 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:21:24.559472 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-890ea37d-9b9e-4387-86dc-079e90fbdc35 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:24.560716 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-890ea37d-9b9e-4387-86dc-079e90fbdc35 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:24.561180 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-890ea37d-9b9e-4387-86dc-079e90fbdc35 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:24.561892 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-890ea37d-9b9e-4387-86dc-079e90fbdc35 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:24.562361 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-890ea37d-9b9e-4387-86dc-079e90fbdc35 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:24.562786 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-890ea37d-9b9e-4387-86dc-079e90fbdc35 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:24.591606 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-890ea37d-9b9e-4387-86dc-079e90fbdc35 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044761 Sep 23 14:21:24.592164 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 565/1127] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 23 14:21:24 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 14:21:24.602918 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-25dc633b-dfc0-499c-ba6f-6880ff8e3994 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:21:24.603485 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-25dc633b-dfc0-499c-ba6f-6880ff8e3994 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:21:24.611402 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25dc633b-dfc0-499c-ba6f-6880ff8e3994 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:24.611894 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25dc633b-dfc0-499c-ba6f-6880ff8e3994 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:24.612333 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25dc633b-dfc0-499c-ba6f-6880ff8e3994 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:24.613034 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25dc633b-dfc0-499c-ba6f-6880ff8e3994 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:24.613490 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25dc633b-dfc0-499c-ba6f-6880ff8e3994 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:24.613920 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-25dc633b-dfc0-499c-ba6f-6880ff8e3994 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:24.688826 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.wsgi [None req-25dc633b-dfc0-499c-ba6f-6880ff8e3994 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] HTTP exception thrown: Instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd is not attached to volume 08b53cff-e79e-4281-b41a-4394cf237973 Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-25dc633b-dfc0-499c-ba6f-6880ff8e3994 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Request method failure captured: Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: request: DELETE /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/os-volume_attachments/08b53cff-e79e-4281-b41a-4394cf237973 HTTP/1.1 Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept: application/json Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Accept-Encoding: identity Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Connection: close Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Length: 0 Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Content-Type: application/json Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Host: 10.222.0.62 Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: Openstack-System-Scope: None Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: User-Agent: python-urllib3/1.26.12 Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Auth-Token: gAAAAABjLcBdauB6_8jFW5mksZ6QG_LA0MrbppbEThr9KVesagmPFocpxE8wWVrq6YIrAg9GBu1DgEji_6h_tvF5t81QCGpZJBuD4AHiKMYEhnhAMBsKzHEL2oYfe3755-58qokEotrij-cZSGaAR6cnK5QUxB4u1VTQzaHdJ1WeWgDRHjuBkgA Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Id: None Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Domain-Name: None Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Identity-Status: Confirmed Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Is-Admin-Project: True Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Id: default Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Domain-Name: Default Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Id: 6ac60e3f01644a258f0a7ebddf8f4d30 Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Project-Name: tempest-TestMinimumBasicScenario-701120692 Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Role: reader,member Sep 23 14:21:24.691237 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Roles: reader,member Sep 23 14:21:24.693048 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6ac60e3f01644a258f0a7ebddf8f4d30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6ac60e3f01644a258f0a7ebddf8f4d30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6ac60e3f01644a258f0a7ebddf8f4d30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6ac60e3f01644a258f0a7ebddf8f4d30"}]}] Sep 23 14:21:24.693048 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant: tempest-TestMinimumBasicScenario-701120692 Sep 23 14:21:24.693048 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Id: 6ac60e3f01644a258f0a7ebddf8f4d30 Sep 23 14:21:24.693048 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-Tenant-Name: tempest-TestMinimumBasicScenario-701120692 Sep 23 14:21:24.693048 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User: tempest-TestMinimumBasicScenario-701120692-project Sep 23 14:21:24.693048 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Id: default Sep 23 14:21:24.693048 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Domain-Name: Default Sep 23 14:21:24.693048 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Id: 6e2be66df7b14b18b55bea07799abab3 Sep 23 14:21:24.693048 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: X-User-Name: tempest-TestMinimumBasicScenario-701120692-project Sep 23 14:21:24.693048 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: method: > Sep 23 14:21:24.693048 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: exception: Instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd is not attached to volume 08b53cff-e79e-4281-b41a-4394cf237973 Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: action_args: {'server_id': '37cc15dc-ee4a-49f7-9b22-aaeacba00bbd', 'id': '08b53cff-e79e-4281-b41a-4394cf237973'} Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 08b53cff-e79e-4281-b41a-4394cf237973. Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:21:24.693980 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd is not attached to volume 08b53cff-e79e-4281-b41a-4394cf237973 Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd is not attached to volume 08b53cff-e79e-4281-b41a-4394cf237973 Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR nova.api.openstack.wsgi Sep 23 14:21:24.695667 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-25dc633b-dfc0-499c-ba6f-6880ff8e3994 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Returning 404 to user: Instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd is not attached to volume 08b53cff-e79e-4281-b41a-4394cf237973 {{(pid=121074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:21:24.697235 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-25dc633b-dfc0-499c-ba6f-6880ff8e3994 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "DELETE /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/os-volume_attachments/08b53cff-e79e-4281-b41a-4394cf237973" status: 404 len: 154 microversion: 2.1 time: 0.093790 Sep 23 14:21:24.697235 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 563/1128] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 23 14:21:24 2022] DELETE /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd/os-volume_attachments/08b53cff-e79e-4281-b41a-4394cf237973 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:21:26.000759 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-37056df9-b43d-43b9-8e93-dc9279394c53 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:21:26.001334 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-37056df9-b43d-43b9-8e93-dc9279394c53 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:21:26.008193 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-37056df9-b43d-43b9-8e93-dc9279394c53 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:26.008193 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-37056df9-b43d-43b9-8e93-dc9279394c53 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:26.008636 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-37056df9-b43d-43b9-8e93-dc9279394c53 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:26.009339 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-37056df9-b43d-43b9-8e93-dc9279394c53 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:26.009794 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-37056df9-b43d-43b9-8e93-dc9279394c53 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:26.010222 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-37056df9-b43d-43b9-8e93-dc9279394c53 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:26.037851 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-37056df9-b43d-43b9-8e93-dc9279394c53 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Going to try to terminate instance {{(pid=121073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 14:21:26.340812 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-37056df9-b43d-43b9-8e93-dc9279394c53 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "DELETE /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 204 len: 0 microversion: 2.1 time: 0.343890 Sep 23 14:21:26.341605 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 566/1129] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 23 14:21:25 2022] DELETE /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 14:21:26.349734 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-145f0b7a-afff-4b37-9dcc-328d664674a8 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:21:26.350375 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-145f0b7a-afff-4b37-9dcc-328d664674a8 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:21:26.360111 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-145f0b7a-afff-4b37-9dcc-328d664674a8 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:26.360601 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-145f0b7a-afff-4b37-9dcc-328d664674a8 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:26.361037 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-145f0b7a-afff-4b37-9dcc-328d664674a8 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:26.361738 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-145f0b7a-afff-4b37-9dcc-328d664674a8 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:26.362190 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-145f0b7a-afff-4b37-9dcc-328d664674a8 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:26.362654 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-145f0b7a-afff-4b37-9dcc-328d664674a8 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:26.494442 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-145f0b7a-afff-4b37-9dcc-328d664674a8 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:21:26.502356 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-145f0b7a-afff-4b37-9dcc-328d664674a8 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1553 microversion: 2.1 time: 0.156505 Sep 23 14:21:26.502994 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 564/1130] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:21:26 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:21:27.525961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-5cee3501-0ea1-4439-ace0-67abbbf2cf43 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:21:27.526604 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-5cee3501-0ea1-4439-ace0-67abbbf2cf43 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:21:27.533656 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5cee3501-0ea1-4439-ace0-67abbbf2cf43 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:27.534137 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5cee3501-0ea1-4439-ace0-67abbbf2cf43 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:27.534599 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5cee3501-0ea1-4439-ace0-67abbbf2cf43 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:27.535278 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5cee3501-0ea1-4439-ace0-67abbbf2cf43 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:27.535730 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5cee3501-0ea1-4439-ace0-67abbbf2cf43 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:27.536149 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-5cee3501-0ea1-4439-ace0-67abbbf2cf43 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:27.665547 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.policy [None req-5cee3501-0ea1-4439-ace0-67abbbf2cf43 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:21:27.673443 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-5cee3501-0ea1-4439-ace0-67abbbf2cf43 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1553 microversion: 2.1 time: 0.152032 Sep 23 14:21:27.674020 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 567/1131] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:21:27 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:21:28.697055 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-63c6b187-8079-4e34-8aa9-282fcee179fb tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:21:28.697722 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-63c6b187-8079-4e34-8aa9-282fcee179fb tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:21:28.704769 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63c6b187-8079-4e34-8aa9-282fcee179fb tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:28.705262 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63c6b187-8079-4e34-8aa9-282fcee179fb tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:28.705698 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63c6b187-8079-4e34-8aa9-282fcee179fb tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:28.706429 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63c6b187-8079-4e34-8aa9-282fcee179fb tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:28.706890 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63c6b187-8079-4e34-8aa9-282fcee179fb tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:28.707316 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-63c6b187-8079-4e34-8aa9-282fcee179fb tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:28.841537 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-63c6b187-8079-4e34-8aa9-282fcee179fb tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:21:28.850148 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-63c6b187-8079-4e34-8aa9-282fcee179fb tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1553 microversion: 2.1 time: 0.156855 Sep 23 14:21:28.850691 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 565/1132] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:21:28 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:21:29.096781 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [req-f2ed0b50-3ac6-4582-9b0b-d08de03b1371 req-90f5e0aa-9035-417d-956f-3b491ab20674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37cc15dc-ee4a-49f7-9b22-aaeacba00bbd", "name": "network-vif-deleted", "tag": "8fc5fd76-db4f-4ef2-92ab-38a75f0a6856"}]} {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 14:21:29.110641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-f2ed0b50-3ac6-4582-9b0b-d08de03b1371 req-90f5e0aa-9035-417d-956f-3b491ab20674 service nova] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:29.110641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-f2ed0b50-3ac6-4582-9b0b-d08de03b1371 req-90f5e0aa-9035-417d-956f-3b491ab20674 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:29.110641 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [req-f2ed0b50-3ac6-4582-9b0b-d08de03b1371 req-90f5e0aa-9035-417d-956f-3b491ab20674 service nova] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:29.123502 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.compute.server_external_events [req-f2ed0b50-3ac6-4582-9b0b-d08de03b1371 req-90f5e0aa-9035-417d-956f-3b491ab20674 service nova] Creating event network-vif-deleted:8fc5fd76-db4f-4ef2-92ab-38a75f0a6856 for instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd on hv-cinder-85743 Sep 23 14:21:29.130371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [req-f2ed0b50-3ac6-4582-9b0b-d08de03b1371 req-90f5e0aa-9035-417d-956f-3b491ab20674 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035335 Sep 23 14:21:29.130371 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 568/1133] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 23 14:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 14:21:29.873142 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-22a9285e-4107-4d63-bf0e-073c67323913 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:21:29.873767 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.compute.api [None req-22a9285e-4107-4d63-bf0e-073c67323913 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:21:29.880174 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22a9285e-4107-4d63-bf0e-073c67323913 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:29.880681 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22a9285e-4107-4d63-bf0e-073c67323913 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:29.881121 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22a9285e-4107-4d63-bf0e-073c67323913 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:29.881808 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22a9285e-4107-4d63-bf0e-073c67323913 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:29.882259 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22a9285e-4107-4d63-bf0e-073c67323913 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:29.882707 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22a9285e-4107-4d63-bf0e-073c67323913 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:29.914051 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22a9285e-4107-4d63-bf0e-073c67323913 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:29.914481 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22a9285e-4107-4d63-bf0e-073c67323913 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:29.914919 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG oslo_concurrency.lockutils [None req-22a9285e-4107-4d63-bf0e-073c67323913 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:29.915368 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.objects.instance [None req-22a9285e-4107-4d63-bf0e-073c67323913 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lazy-loading 'fault' on Instance uuid 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd {{(pid=121074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 14:21:29.958880 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.policy [None req-22a9285e-4107-4d63-bf0e-073c67323913 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2be66df7b14b18b55bea07799abab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ac60e3f01644a258f0a7ebddf8f4d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 14:21:29.967195 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-22a9285e-4107-4d63-bf0e-073c67323913 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 200 len: 1348 microversion: 2.1 time: 0.098286 Sep 23 14:21:29.967775 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 566/1134] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:21:29 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 14:21:30.992222 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a0773f28-908a-4555-aad2-51dfca0f8c65 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '>' {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:21:30.992959 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.compute.api [None req-a0773f28-908a-4555-aad2-51dfca0f8c65 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [instance: 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd] Fetching instance by UUID {{(pid=121073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 14:21:30.999167 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0773f28-908a-4555-aad2-51dfca0f8c65 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:30.999647 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0773f28-908a-4555-aad2-51dfca0f8c65 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:31.000090 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0773f28-908a-4555-aad2-51dfca0f8c65 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:31.000775 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0773f28-908a-4555-aad2-51dfca0f8c65 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Acquiring lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 14:21:31.001234 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0773f28-908a-4555-aad2-51dfca0f8c65 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 14:21:31.001656 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG oslo_concurrency.lockutils [None req-a0773f28-908a-4555-aad2-51dfca0f8c65 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Lock "c9b62a15-663d-4061-af73-b76bf6ffc81b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 14:21:31.015166 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.wsgi [None req-a0773f28-908a-4555-aad2-51dfca0f8c65 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] HTTP exception thrown: Instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd could not be found. Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a0773f28-908a-4555-aad2-51dfca0f8c65 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Request method failure captured: Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: request: GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd HTTP/1.1 Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept: application/json Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Accept-Encoding: identity Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Connection: close Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Length: 0 Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Content-Type: application/json Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Host: 10.222.0.62 Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: Openstack-System-Scope: None Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: User-Agent: python-urllib3/1.26.12 Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Auth-Token: gAAAAABjLcBdauB6_8jFW5mksZ6QG_LA0MrbppbEThr9KVesagmPFocpxE8wWVrq6YIrAg9GBu1DgEji_6h_tvF5t81QCGpZJBuD4AHiKMYEhnhAMBsKzHEL2oYfe3755-58qokEotrij-cZSGaAR6cnK5QUxB4u1VTQzaHdJ1WeWgDRHjuBkgA Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Id: None Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Domain-Name: None Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Identity-Status: Confirmed Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Is-Admin-Project: True Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Id: default Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Domain-Name: Default Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Id: 6ac60e3f01644a258f0a7ebddf8f4d30 Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Project-Name: tempest-TestMinimumBasicScenario-701120692 Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Role: reader,member Sep 23 14:21:31.016756 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Roles: reader,member Sep 23 14:21:31.018464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6ac60e3f01644a258f0a7ebddf8f4d30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6ac60e3f01644a258f0a7ebddf8f4d30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6ac60e3f01644a258f0a7ebddf8f4d30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6ac60e3f01644a258f0a7ebddf8f4d30"}]}] Sep 23 14:21:31.018464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant: tempest-TestMinimumBasicScenario-701120692 Sep 23 14:21:31.018464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Id: 6ac60e3f01644a258f0a7ebddf8f4d30 Sep 23 14:21:31.018464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-Tenant-Name: tempest-TestMinimumBasicScenario-701120692 Sep 23 14:21:31.018464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User: tempest-TestMinimumBasicScenario-701120692-project Sep 23 14:21:31.018464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Id: default Sep 23 14:21:31.018464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Domain-Name: Default Sep 23 14:21:31.018464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Id: 6e2be66df7b14b18b55bea07799abab3 Sep 23 14:21:31.018464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: X-User-Name: tempest-TestMinimumBasicScenario-701120692-project Sep 23 14:21:31.018464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: method: > Sep 23 14:21:31.018464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: exception: Instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd could not be found. Sep 23 14:21:31.018464 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: action_args: {'id': '37cc15dc-ee4a-49f7-9b22-aaeacba00bbd'} Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: {{(pid=121073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd could not be found. Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 14:21:31.019346 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd could not be found. Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd could not be found. Sep 23 14:21:31.020961 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: ERROR nova.api.openstack.wsgi Sep 23 14:21:31.022491 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: DEBUG nova.api.openstack.wsgi [None req-a0773f28-908a-4555-aad2-51dfca0f8c65 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Returning 404 to user: Instance 37cc15dc-ee4a-49f7-9b22-aaeacba00bbd could not be found. {{(pid=121073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 14:21:31.022491 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: INFO nova.api.openstack.requestlog [None req-a0773f28-908a-4555-aad2-51dfca0f8c65 tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd" status: 404 len: 111 microversion: 2.1 time: 0.030723 Sep 23 14:21:31.022491 dv-cinder-857434-4-iscsi devstack@n-api.service[121073]: [pid: 121073|app: 0|req: 569/1135] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 23 14:21:30 2022] GET /compute/v2.1/servers/37cc15dc-ee4a-49f7-9b22-aaeacba00bbd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 14:21:31.026936 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: DEBUG nova.api.openstack.wsgi [None req-d3a22997-02ad-4a61-ba99-7cd74438b72c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] Calling method '.version_select at 0x7f908b475ee0>' {{(pid=121074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 14:21:31.032127 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d3a22997-02ad-4a61-ba99-7cd74438b72c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [0b8ac930-1ffd-46f4-87c6-8e340d45be1d] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 14:21:32.040342 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO oslo.messaging._drivers.impl_rabbit [None req-d3a22997-02ad-4a61-ba99-7cd74438b72c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] [0b8ac930-1ffd-46f4-87c6-8e340d45be1d] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 51692. Sep 23 14:21:32.110803 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: INFO nova.api.openstack.requestlog [None req-d3a22997-02ad-4a61-ba99-7cd74438b72c tempest-TestMinimumBasicScenario-701120692 tempest-TestMinimumBasicScenario-701120692-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-239935108" status: 202 len: 0 microversion: 2.1 time: 1.087793 Sep 23 14:21:32.111649 dv-cinder-857434-4-iscsi devstack@n-api.service[121074]: [pid: 121074|app: 0|req: 567/1136] 10.222.0.62 () {58 vars in 1269 bytes} [Fri Sep 23 14:21:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-239935108 => generated 0 bytes in 1089 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)